[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:01 dist-test-slave-rmhg krb5kdc[30032](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:01 dist-test-slave-rmhg krb5kdc[30032](info): set up 2 sockets
Aug 08 07:05:01 dist-test-slave-rmhg krb5kdc[30032](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 07:05:03.367053 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.598s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:05:03 dist-test-slave-rmhg krb5kdc[30032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:05:03.522586 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:38061
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:33785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:38061
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:03.608299 30053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:03.608520 30053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:03.608539 30053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:03.609742 30053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:03.609786 30053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:03.609798 30053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:03.609812 30053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:03.609836 30053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:03.611400 30053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:33785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:38061
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:38061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:03.611656 30053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:03.611878 30053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:03.617269 30064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:03.617285 30061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:03.617302 30059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:03.617303 30053 server_base.cc:1034] running on GCE node
I20260808 07:05:03.617792 30053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:03.618074 30053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:03.619217 30053 hybrid_clock.cc:648] HybridClock initialized: now 1786172703619172 us; error 70 us; skew 500 ppm
Aug 08 07:05:03 dist-test-slave-rmhg krb5kdc[30032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172703, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:03.621871 30053 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:05:03.622368 30053 webserver.cc:460] Webserver started at http://127.29.82.126:35707/ using document root <none> and password file <none>
I20260808 07:05:03.622617 30053 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:03.622665 30053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:03.622790 30053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:03.623850 30053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "c2d7727fe8e64d3885485540c6702c68"
format_stamp: "Formatted at 2026-08-08 07:05:03 on dist-test-slave-rmhg"
server_key: "e5f473404b46bb7f66d16a17d33bd243"
server_key_iv: "83ae3cdb1d87dd4398985bed09b69b26"
server_key_version: "encryptionkey@0"
I20260808 07:05:03.624208 30053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "c2d7727fe8e64d3885485540c6702c68"
format_stamp: "Formatted at 2026-08-08 07:05:03 on dist-test-slave-rmhg"
server_key: "e5f473404b46bb7f66d16a17d33bd243"
server_key_iv: "83ae3cdb1d87dd4398985bed09b69b26"
server_key_version: "encryptionkey@0"
I20260808 07:05:03.625651 30053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:03.626434 30076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:03.626631 30053 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:03.626725 30053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "c2d7727fe8e64d3885485540c6702c68"
format_stamp: "Formatted at 2026-08-08 07:05:03 on dist-test-slave-rmhg"
server_key: "e5f473404b46bb7f66d16a17d33bd243"
server_key_iv: "83ae3cdb1d87dd4398985bed09b69b26"
server_key_version: "encryptionkey@0"
I20260808 07:05:03.626791 30053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:03.652715 30053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:03.655192 30053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:03.655344 30053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:03.659821 30053 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:38061
I20260808 07:05:03.659826 30151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:38061 every 8 connection(s)
I20260808 07:05:03.660243 30053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:03.661129 30152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:03.663600 30152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68: Bootstrap starting.
I20260808 07:05:03.664207 30152 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:03.664510 30152 log.cc:824] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:03.665272 30152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68: No bootstrap required, opened a new log
I20260808 07:05:03.666944 30152 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d7727fe8e64d3885485540c6702c68" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38061 } }
I20260808 07:05:03.667092 30152 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:03.667114 30152 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d7727fe8e64d3885485540c6702c68, State: Initialized, Role: FOLLOWER
I20260808 07:05:03.667222 30152 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d7727fe8e64d3885485540c6702c68" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38061 } }
I20260808 07:05:03.667274 30152 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:03.667294 30152 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:03.667337 30152 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:03.667906 30152 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d7727fe8e64d3885485540c6702c68" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38061 } }
I20260808 07:05:03.668006 30152 leader_election.cc:302] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2d7727fe8e64d3885485540c6702c68; no voters:
I20260808 07:05:03.668184 30152 leader_election.cc:288] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:03.668234 30156 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:03.668390 30156 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [term 1 LEADER]: Becoming Leader. State: Replica: c2d7727fe8e64d3885485540c6702c68, State: Running, Role: LEADER
I20260808 07:05:03.668475 30152 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:03.668601 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 30053
I20260808 07:05:03.668618 30156 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d7727fe8e64d3885485540c6702c68" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38061 } }
I20260808 07:05:03.668705 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:03.669139 30160 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2d7727fe8e64d3885485540c6702c68. Latest consensus state: current_term: 1 leader_uuid: "c2d7727fe8e64d3885485540c6702c68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d7727fe8e64d3885485540c6702c68" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38061 } } }
I20260808 07:05:03.669283 30160 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:03.669572 30025 external_mini_cluster.cc:1428] Setting key cfde596a616c91554cfb403df911f869
I20260808 07:05:03.671154 30162 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2d7727fe8e64d3885485540c6702c68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d7727fe8e64d3885485540c6702c68" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38061 } } }
I20260808 07:05:03.671265 30168 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:03.671279 30162 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:03.672003 30168 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:03.673779 30168 catalog_manager.cc:1347] Generated new cluster ID: 0b458825fbc34d71b478980c02d9113d
I20260808 07:05:03.673835 30168 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:05:03 dist-test-slave-rmhg krb5kdc[30032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:03.687971 30168 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:03.688505 30182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:03.671268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34420 (local address 127.29.82.126:38061)
0808 07:05:03.671589 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:03.671600 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:03.672356 (+ 756us) server_negotiation.cc:407] Connection header received
0808 07:05:03.674116 (+ 1760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:03.674124 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:03.674179 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:03.674341 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:03.676211 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:03.677722 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:03.679210 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:03.679847 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:03.679963 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:03.684255 (+ 4292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:03.684261 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:03.684261 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:03.684275 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:03.686236 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:03.686755 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:03.686758 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:03.686758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:03.686871 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:03.687163 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:03.687164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:03.687164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:03.687430 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:03.687588 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:03.687895 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 07:05:03.688055 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":77,"threads_started":1}
I20260808 07:05:03.688719 30168 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:03.698741 30168 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2d7727fe8e64d3885485540c6702c68: Generated new TSK 0
I20260808 07:05:03.698988 30168 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:05:03.731949 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38061
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:33785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:03.817548 30196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:03.817927 30196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:03.817956 30196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:03.819305 30196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:03.819365 30196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:03.819396 30196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:05:03.821035 30196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:33785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38061
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:03.821338 30196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:03.821593 30196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:03.826925 30206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:03.826947 30203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:03.826936 30204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:03.827026 30196 server_base.cc:1034] running on GCE node
I20260808 07:05:03.827404 30196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:03.827672 30196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:03.828908 30196 hybrid_clock.cc:648] HybridClock initialized: now 1786172703828880 us; error 30 us; skew 500 ppm
Aug 08 07:05:03 dist-test-slave-rmhg krb5kdc[30032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172703, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:03.831866 30196 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:05:03.832311 30196 webserver.cc:460] Webserver started at http://127.29.82.65:37989/ using document root <none> and password file <none>
I20260808 07:05:03.832496 30196 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:03.832545 30196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:03.832645 30196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:03.833741 30196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "319f582b677642999b9efc029f1979a7"
format_stamp: "Formatted at 2026-08-08 07:05:03 on dist-test-slave-rmhg"
server_key: "e58efec0969f467cb905093aee505465"
server_key_iv: "813dadb184ad45f671deddc1870733e6"
server_key_version: "encryptionkey@0"
I20260808 07:05:03.834056 30196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "319f582b677642999b9efc029f1979a7"
format_stamp: "Formatted at 2026-08-08 07:05:03 on dist-test-slave-rmhg"
server_key: "e58efec0969f467cb905093aee505465"
server_key_iv: "813dadb184ad45f671deddc1870733e6"
server_key_version: "encryptionkey@0"
I20260808 07:05:03.835355 30196 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:03.836138 30215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:03.836342 30196 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:03.836479 30196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "319f582b677642999b9efc029f1979a7"
format_stamp: "Formatted at 2026-08-08 07:05:03 on dist-test-slave-rmhg"
server_key: "e58efec0969f467cb905093aee505465"
server_key_iv: "813dadb184ad45f671deddc1870733e6"
server_key_version: "encryptionkey@0"
I20260808 07:05:03.836550 30196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:03.847097 30196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:03.849370 30196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:03.849524 30196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:03.849763 30196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:03.850093 30196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:03.850128 30196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:03.850157 30196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:03.850175 30196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:03.856370 30196 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:35243
I20260808 07:05:03.856446 30383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:35243 every 8 connection(s)
I20260808 07:05:03.856760 30196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:05:03.858071 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 30196
I20260808 07:05:03.858166 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:03.858314 30025 external_mini_cluster.cc:1428] Setting key cfa4d4eabcb56c56932f2310c47a7e4f
Aug 08 07:05:03 dist-test-slave-rmhg krb5kdc[30032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172703, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:03.867151 30182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:03.857513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:60653 (local address 127.29.82.126:38061)
0808 07:05:03.857564 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:03.857566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:03.857761 (+ 195us) server_negotiation.cc:407] Connection header received
0808 07:05:03.858292 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:03.858294 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:03.858312 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:03.858372 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:03.859638 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:03.860144 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:03.861421 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:03.861648 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:03.861715 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:03.864194 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:03.864197 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:03.864197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:03.864206 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:03.865803 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:03.866197 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:03.866198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:03.866199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:03.866262 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:03.866473 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:03.866474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:03.866474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:03.866621 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:03.866687 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:03.866953 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 07:05:03.867048 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:05:03.867238 30388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:03.857491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38061 (local address 127.29.82.65:60653)
0808 07:05:03.857637 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:03.857674 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:03.858191 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:03.858449 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:03.858453 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:03.859333 (+ 880us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:03.859545 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:03.859550 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:03.860224 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:03.860225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:03.861338 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:03.861341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:03.861734 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:03.861735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:03.861897 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:03.862450 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:03.862460 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:03.864092 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:03.865885 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:03.865892 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:03.865894 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:03.866127 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:03.866325 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:03.866325 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:03.866326 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:03.866418 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:03.866689 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:03.866693 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:03.866821 (+ 128us) client_negotiation.cc:769] Sending connection context
0808 07:05:03.866900 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 07:05:03.867045 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":66,"threads_started":1}
I20260808 07:05:03.867789 30384 heartbeater.cc:347] Connected to a master server at 127.29.82.126:38061
I20260808 07:05:03.867908 30384 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
I20260808 07:05:03.868119 30384 heartbeater.cc:511] Master 127.29.82.126:38061 requested a full tablet report, sending...
I20260808 07:05:03.868716 30108 ts_manager.cc:194] Registered new tserver with Master: 319f582b677642999b9efc029f1979a7 (127.29.82.65:35243)
I20260808 07:05:03.869475 30108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:60653
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:05:03.888142 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38061
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:33785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:03.972640 30392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:03.972851 30392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:03.972874 30392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:03.974047 30392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:03.974094 30392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:03.974119 30392 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:05:03.975610 30392 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:33785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38061
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:03.975847 30392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:03.976073 30392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:03.981272 30403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:03.981276 30397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:03.981405 30392 server_base.cc:1034] running on GCE node
W20260808 07:05:03.981320 30400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:03.981788 30392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:03.982031 30392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:03.983194 30392 hybrid_clock.cc:648] HybridClock initialized: now 1786172703983178 us; error 27 us; skew 500 ppm
Aug 08 07:05:03 dist-test-slave-rmhg krb5kdc[30032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172703, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:03.985849 30392 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:05:03.986291 30392 webserver.cc:460] Webserver started at http://127.29.82.66:45877/ using document root <none> and password file <none>
I20260808 07:05:03.986510 30392 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:03.986569 30392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:03.986694 30392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:03.987754 30392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "660558c823634dbdbb8cb5d75d494427"
format_stamp: "Formatted at 2026-08-08 07:05:03 on dist-test-slave-rmhg"
server_key: "5608fb07b06bf8a71e7c3bbb611e87a8"
server_key_iv: "01d7a3ef86d7af975d6627e2bd8adba7"
server_key_version: "encryptionkey@0"
I20260808 07:05:03.988085 30392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "660558c823634dbdbb8cb5d75d494427"
format_stamp: "Formatted at 2026-08-08 07:05:03 on dist-test-slave-rmhg"
server_key: "5608fb07b06bf8a71e7c3bbb611e87a8"
server_key_iv: "01d7a3ef86d7af975d6627e2bd8adba7"
server_key_version: "encryptionkey@0"
I20260808 07:05:03.989441 30392 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:03.990221 30411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:03.990376 30392 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:03.990469 30392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "660558c823634dbdbb8cb5d75d494427"
format_stamp: "Formatted at 2026-08-08 07:05:03 on dist-test-slave-rmhg"
server_key: "5608fb07b06bf8a71e7c3bbb611e87a8"
server_key_iv: "01d7a3ef86d7af975d6627e2bd8adba7"
server_key_version: "encryptionkey@0"
I20260808 07:05:03.990530 30392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:04.002627 30392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:04.004814 30392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:04.004973 30392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:04.005280 30392 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:04.005600 30392 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:04.005635 30392 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:04.005664 30392 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:04.005682 30392 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:04.011847 30392 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:45323
I20260808 07:05:04.011952 30589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:45323 every 8 connection(s)
I20260808 07:05:04.012228 30392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:05:04.014032 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 30392
I20260808 07:05:04.014137 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:04.014310 30025 external_mini_cluster.cc:1428] Setting key 7c22d12d9a41d28d345611914b34ad82
Aug 08 07:05:04 dist-test-slave-rmhg krb5kdc[30032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172703, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:04.022899 30182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:04.012998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:46435 (local address 127.29.82.126:38061)
0808 07:05:04.013065 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:04.013067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:04.013298 (+ 231us) server_negotiation.cc:407] Connection header received
0808 07:05:04.013995 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:04.013996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:04.014009 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:04.014071 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:04.015435 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:04.015939 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:04.017372 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:04.017672 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:04.017772 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:04.020098 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:04.020100 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:04.020100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:04.020108 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:04.021519 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:04.021934 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:04.021935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:04.021935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:04.021992 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:04.022222 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:04.022223 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:04.022224 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:04.022341 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:04.022397 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:04.022680 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 07:05:04.022777 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 07:05:04.023056 30592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:04.012949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38061 (local address 127.29.82.66:46435)
0808 07:05:04.013170 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:04.013215 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:04.013731 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:04.014197 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:04.014203 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:04.015039 (+ 836us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:04.015329 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:04.015337 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:04.016033 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:04.016034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:04.017287 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:04.017291 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:04.017774 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:04.017775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:04.017896 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:04.018458 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:04.018468 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:04.019992 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:04.021604 (+ 1612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:04.021612 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:04.021616 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:04.021852 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:04.022051 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:04.022051 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:04.022052 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:04.022163 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:04.022397 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:04.022405 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:04.022558 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 07:05:04.022649 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 07:05:04.022820 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":104,"threads_started":1}
I20260808 07:05:04.023510 30590 heartbeater.cc:347] Connected to a master server at 127.29.82.126:38061
I20260808 07:05:04.023607 30590 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
I20260808 07:05:04.023808 30590 heartbeater.cc:511] Master 127.29.82.126:38061 requested a full tablet report, sending...
I20260808 07:05:04.024240 30108 ts_manager.cc:194] Registered new tserver with Master: 660558c823634dbdbb8cb5d75d494427 (127.29.82.66:45323)
I20260808 07:05:04.024688 30108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:46435
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:05:04.042011 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38061
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:33785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:04.128180 30596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:04.128394 30596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:04.128419 30596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:04.129657 30596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:04.129701 30596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:04.129729 30596 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:05:04.131243 30596 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:33785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38061
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:04.131474 30596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:04.131707 30596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:04.136813 30603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:04.136853 30605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:04.136823 30602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:04.137116 30596 server_base.cc:1034] running on GCE node
I20260808 07:05:04.137359 30596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:04.137612 30596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:04.138782 30596 hybrid_clock.cc:648] HybridClock initialized: now 1786172704138757 us; error 36 us; skew 500 ppm
Aug 08 07:05:04 dist-test-slave-rmhg krb5kdc[30032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172704, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:04.141393 30596 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:05:04.141799 30596 webserver.cc:460] Webserver started at http://127.29.82.67:38983/ using document root <none> and password file <none>
I20260808 07:05:04.142001 30596 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:04.142042 30596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:04.142144 30596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:04.143162 30596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "ac778154938a48749df7628953d2fdb0"
format_stamp: "Formatted at 2026-08-08 07:05:04 on dist-test-slave-rmhg"
server_key: "8ef5c45c7f45a237f836ddce1c0a9d26"
server_key_iv: "2bf0c0fb0622a0e3dbeb7080f8055473"
server_key_version: "encryptionkey@0"
I20260808 07:05:04.143476 30596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "ac778154938a48749df7628953d2fdb0"
format_stamp: "Formatted at 2026-08-08 07:05:04 on dist-test-slave-rmhg"
server_key: "8ef5c45c7f45a237f836ddce1c0a9d26"
server_key_iv: "2bf0c0fb0622a0e3dbeb7080f8055473"
server_key_version: "encryptionkey@0"
I20260808 07:05:04.144763 30596 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:05:04.145543 30614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:04.145706 30596 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:05:04.145792 30596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "ac778154938a48749df7628953d2fdb0"
format_stamp: "Formatted at 2026-08-08 07:05:04 on dist-test-slave-rmhg"
server_key: "8ef5c45c7f45a237f836ddce1c0a9d26"
server_key_iv: "2bf0c0fb0622a0e3dbeb7080f8055473"
server_key_version: "encryptionkey@0"
I20260808 07:05:04.145846 30596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:04.158376 30596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:04.160166 30596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:04.160279 30596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:04.160506 30596 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:04.160815 30596 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:04.160848 30596 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:04.160868 30596 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:04.160881 30596 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:04.167191 30596 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:38495
I20260808 07:05:04.167255 30780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:38495 every 8 connection(s)
I20260808 07:05:04.167567 30596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:05:04.167727 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 30596
I20260808 07:05:04.167826 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:04.168040 30025 external_mini_cluster.cc:1428] Setting key a4dfee76556f881dd21cf7e43620b70c
Aug 08 07:05:04 dist-test-slave-rmhg krb5kdc[30032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172704, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:04.176666 30182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:04.168449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:57913 (local address 127.29.82.126:38061)
0808 07:05:04.168497 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:04.168499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:04.168658 (+ 159us) server_negotiation.cc:407] Connection header received
0808 07:05:04.169259 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:04.169260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:04.169272 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:04.169307 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:04.170295 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:04.170797 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:04.171864 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:04.172073 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:04.172129 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:04.174253 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:04.174255 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:04.174256 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:04.174264 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:04.175373 (+ 1109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:04.175775 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:04.175776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:04.175777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:04.175831 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:04.176050 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:04.176051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:04.176051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:04.176169 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:04.176227 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:04.176486 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 07:05:04.176569 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:05:04.176842 30783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:04.168357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38061 (local address 127.29.82.67:57913)
0808 07:05:04.168534 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:04.168582 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:04.169172 (+ 590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:04.169388 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:04.169393 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:04.170000 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:04.170204 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:04.170209 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:04.170880 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:04.170881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:04.171783 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:04.171786 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:04.172145 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:04.172146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:04.172290 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:04.172806 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:04.172815 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:04.174168 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:04.175447 (+ 1279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:04.175454 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:04.175456 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:04.175705 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:04.175886 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:04.175887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:04.175888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:04.175992 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:04.176225 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:04.176232 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:04.176364 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 07:05:04.176453 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 07:05:04.176624 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":87,"threads_started":1}
I20260808 07:05:04.177389 30781 heartbeater.cc:347] Connected to a master server at 127.29.82.126:38061
I20260808 07:05:04.177548 30781 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:04.177754 30781 heartbeater.cc:511] Master 127.29.82.126:38061 requested a full tablet report, sending...
I20260808 07:05:04.178146 30108 ts_manager.cc:194] Registered new tserver with Master: ac778154938a48749df7628953d2fdb0 (127.29.82.67:38495)
I20260808 07:05:04.178531 30108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:57913
I20260808 07:05:04.180068 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:05:04 dist-test-slave-rmhg krb5kdc[30032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172704, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:05:04 dist-test-slave-rmhg krb5kdc[30032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172704, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.82.65@KRBTEST.COM
I20260808 07:05:04.204128 30791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:04.197021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49344 (local address 127.29.82.65:35243)
0808 07:05:04.197217 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:04.197222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:04.197233 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:05:04.197259 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:04.197261 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:04.197274 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:04.197348 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:04.197833 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:04.198572 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:04.199354 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:04.199691 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:04.199751 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:04.201849 (+ 2098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:04.201857 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:04.201857 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:04.201863 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:04.203172 (+ 1309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:04.203459 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:04.203463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:04.203463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:04.203518 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:04.203639 (+ 121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:04.203640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:04.203640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:04.203760 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:04.203876 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:04.203980 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 07:05:04.204044 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":84,"threads_started":1}
W20260808 07:05:04.204491 30255 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49344
Aug 08 07:05:04 dist-test-slave-rmhg krb5kdc[30032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:05:04 dist-test-slave-rmhg krb5kdc[30032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.65@KRBTEST.COM
I20260808 07:05:04.227643 30791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:04.220676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49360 (local address 127.29.82.65:35243)
0808 07:05:04.220782 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:04.220784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:04.220856 (+ 72us) server_negotiation.cc:407] Connection header received
0808 07:05:04.220917 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:04.220918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:04.220932 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:04.220984 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:04.221643 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:04.222146 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:04.222862 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:04.223071 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:04.223124 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:04.225440 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:04.225442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:04.225442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:04.225449 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:04.226724 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:04.227047 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:04.227048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:04.227049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:04.227104 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:04.227230 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:04.227230 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:04.227230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:04.227319 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:04.227397 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:04.227460 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 07:05:04.227565 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 07:05:04.228224 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 30196
I20260808 07:05:04.242592 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 30392
I20260808 07:05:04.255087 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 30596
I20260808 07:05:04.264261 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 30053
2026-08-08T07:05:04Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2524 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:04 dist-test-slave-rmhg krb5kdc[30804](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:04 dist-test-slave-rmhg krb5kdc[30804](info): set up 2 sockets
Aug 08 07:05:04 dist-test-slave-rmhg krb5kdc[30804](info): commencing operation
krb5kdc: starting...
W20260808 07:05:05.389372 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:05:05 dist-test-slave-rmhg krb5kdc[30804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:05:05.514024 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:46219
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:38663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:46219
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:05.598086 30819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:05.598306 30819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:05.598328 30819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:05.599546 30819 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:05.599591 30819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:05.599603 30819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:05.599615 30819 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:05.599625 30819 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:05.601145 30819 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:38663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:46219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:46219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:05.601418 30819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:05.601645 30819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:05.606424 30829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:05.606462 30830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:05.606424 30834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:05.606678 30819 server_base.cc:1034] running on GCE node
I20260808 07:05:05.606921 30819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:05.607213 30819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:05.608364 30819 hybrid_clock.cc:648] HybridClock initialized: now 1786172705608344 us; error 37 us; skew 500 ppm
Aug 08 07:05:05 dist-test-slave-rmhg krb5kdc[30804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172705, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:05.610908 30819 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:05:05.611351 30819 webserver.cc:460] Webserver started at http://127.29.82.126:42469/ using document root <none> and password file <none>
I20260808 07:05:05.611578 30819 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:05.611630 30819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:05.611766 30819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:05.612830 30819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "6a7e8cd60e974642b8290ddbc41798fd"
format_stamp: "Formatted at 2026-08-08 07:05:05 on dist-test-slave-rmhg"
server_key: "3654f682f6852ab3ffe6141ca7b7bf28"
server_key_iv: "5dccaba0b752e02e8665447d0e91bc38"
server_key_version: "encryptionkey@0"
I20260808 07:05:05.613204 30819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "6a7e8cd60e974642b8290ddbc41798fd"
format_stamp: "Formatted at 2026-08-08 07:05:05 on dist-test-slave-rmhg"
server_key: "3654f682f6852ab3ffe6141ca7b7bf28"
server_key_iv: "5dccaba0b752e02e8665447d0e91bc38"
server_key_version: "encryptionkey@0"
I20260808 07:05:05.614526 30819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:05:05.615285 30843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:05.615456 30819 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:05.615535 30819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "6a7e8cd60e974642b8290ddbc41798fd"
format_stamp: "Formatted at 2026-08-08 07:05:05 on dist-test-slave-rmhg"
server_key: "3654f682f6852ab3ffe6141ca7b7bf28"
server_key_iv: "5dccaba0b752e02e8665447d0e91bc38"
server_key_version: "encryptionkey@0"
I20260808 07:05:05.615602 30819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:05.631438 30819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:05.633562 30819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:05.633729 30819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:05.637494 30819 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:46219
I20260808 07:05:05.637539 30919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:46219 every 8 connection(s)
I20260808 07:05:05.637879 30819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:05.638785 30920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:05.640005 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 30819
I20260808 07:05:05.640100 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:05.640257 30025 external_mini_cluster.cc:1428] Setting key 1c7edca8dcaf0099d5cc3e368d9d9502
I20260808 07:05:05.641570 30920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd: Bootstrap starting.
I20260808 07:05:05.642313 30920 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:05.642614 30920 log.cc:824] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:05.643281 30920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd: No bootstrap required, opened a new log
I20260808 07:05:05.645644 30920 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7e8cd60e974642b8290ddbc41798fd" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46219 } }
I20260808 07:05:05.645824 30920 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:05.645874 30920 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a7e8cd60e974642b8290ddbc41798fd, State: Initialized, Role: FOLLOWER
I20260808 07:05:05.646024 30920 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7e8cd60e974642b8290ddbc41798fd" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46219 } }
I20260808 07:05:05.646111 30920 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:05.646154 30920 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:05.646204 30920 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:05.646864 30920 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7e8cd60e974642b8290ddbc41798fd" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46219 } }
I20260808 07:05:05.646960 30920 leader_election.cc:302] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a7e8cd60e974642b8290ddbc41798fd; no voters:
I20260808 07:05:05.647140 30920 leader_election.cc:288] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [CANDIDATE]: Term 1 election: Requested vote from peers
Aug 08 07:05:05 dist-test-slave-rmhg krb5kdc[30804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:05.647179 30932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:05.647300 30932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [term 1 LEADER]: Becoming Leader. State: Replica: 6a7e8cd60e974642b8290ddbc41798fd, State: Running, Role: LEADER
I20260808 07:05:05.647383 30932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7e8cd60e974642b8290ddbc41798fd" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46219 } }
I20260808 07:05:05.647416 30920 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:05.647696 30932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a7e8cd60e974642b8290ddbc41798fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7e8cd60e974642b8290ddbc41798fd" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46219 } } }
I20260808 07:05:05.647769 30932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:05.647902 30932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a7e8cd60e974642b8290ddbc41798fd. Latest consensus state: current_term: 1 leader_uuid: "6a7e8cd60e974642b8290ddbc41798fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a7e8cd60e974642b8290ddbc41798fd" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46219 } } }
I20260808 07:05:05.647974 30932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:05.648150 30940 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:05.649065 30940 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:05.651423 30940 catalog_manager.cc:1347] Generated new cluster ID: ea9649948e454c1ca7ec404bcd7a1a54
I20260808 07:05:05.651525 30940 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:05.652232 30930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:05.640809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51176 (local address 127.29.82.126:46219)
0808 07:05:05.640996 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:05.641005 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:05.641031 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:05:05.641481 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:05.641489 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:05.641541 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:05.641694 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:05.642424 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:05.643441 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:05.644474 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:05.644892 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:05.644972 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:05.647744 (+ 2772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:05.647749 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:05.647749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:05.647762 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:05.650061 (+ 2299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:05.650511 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:05.650514 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:05.650514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:05.650640 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:05.650874 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:05.650875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:05.650876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:05.651216 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:05.651758 (+ 542us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:05.651837 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 07:05:05.651988 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":84,"threads_started":1}
I20260808 07:05:05.666879 30940 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:05.667671 30940 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:05.674722 30940 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a7e8cd60e974642b8290ddbc41798fd: Generated new TSK 0
I20260808 07:05:05.674945 30940 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:05:05.703509 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46219
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:38663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:05.797112 30961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:05.797374 30961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:05.797407 30961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:05.798620 30961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:05.798666 30961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:05.798702 30961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:05:05.800254 30961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:38663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46219
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:05.800503 30961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:05.800733 30961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:05.805747 30967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:05.805874 30961 server_base.cc:1034] running on GCE node
W20260808 07:05:05.805747 30971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:05.805747 30968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:05.806272 30961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:05.806507 30961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:05.807648 30961 hybrid_clock.cc:648] HybridClock initialized: now 1786172705807638 us; error 33 us; skew 500 ppm
Aug 08 07:05:05 dist-test-slave-rmhg krb5kdc[30804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172705, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:05.810237 30961 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:05:05.810662 30961 webserver.cc:460] Webserver started at http://127.29.82.65:37855/ using document root <none> and password file <none>
I20260808 07:05:05.810887 30961 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:05.810937 30961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:05.811074 30961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:05.812131 30961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "4f12249f2bdb42b699e4603bfc764942"
format_stamp: "Formatted at 2026-08-08 07:05:05 on dist-test-slave-rmhg"
server_key: "15c2a6067b838c6291a0b73dc7c03c13"
server_key_iv: "378142e088c3ca6cdd280ffaa8c6bc32"
server_key_version: "encryptionkey@0"
I20260808 07:05:05.812451 30961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "4f12249f2bdb42b699e4603bfc764942"
format_stamp: "Formatted at 2026-08-08 07:05:05 on dist-test-slave-rmhg"
server_key: "15c2a6067b838c6291a0b73dc7c03c13"
server_key_iv: "378142e088c3ca6cdd280ffaa8c6bc32"
server_key_version: "encryptionkey@0"
I20260808 07:05:05.813805 30961 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:05.814465 30981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:05.814633 30961 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:05.814720 30961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "4f12249f2bdb42b699e4603bfc764942"
format_stamp: "Formatted at 2026-08-08 07:05:05 on dist-test-slave-rmhg"
server_key: "15c2a6067b838c6291a0b73dc7c03c13"
server_key_iv: "378142e088c3ca6cdd280ffaa8c6bc32"
server_key_version: "encryptionkey@0"
I20260808 07:05:05.814777 30961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:05.824514 30961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:05.826757 30961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:05.826898 30961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:05.827112 30961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:05.827404 30961 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:05.827438 30961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:05.827478 30961 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:05.827504 30961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:05.832937 30961 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:46345
I20260808 07:05:05.832998 31144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:46345 every 8 connection(s)
I20260808 07:05:05.833326 30961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:05:05 dist-test-slave-rmhg krb5kdc[30804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172705, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:05.839715 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 30961
I20260808 07:05:05.839811 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:05.839982 30025 external_mini_cluster.cc:1428] Setting key 3fe88c2c51a9a648bb8a9d17edea1639
I20260808 07:05:05.843096 30930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:05.834137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:44433 (local address 127.29.82.126:46219)
0808 07:05:05.834204 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:05.834208 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:05.834367 (+ 159us) server_negotiation.cc:407] Connection header received
0808 07:05:05.835308 (+ 941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:05.835309 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:05.835331 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:05.835383 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:05.836021 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:05.836540 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:05.837591 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:05.837816 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:05.837871 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:05.840286 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:05.840288 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:05.840288 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:05.840298 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:05.841685 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:05.842072 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:05.842073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:05.842073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:05.842133 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:05.842436 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:05.842436 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:05.842437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:05.842597 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:05.842661 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:05.842902 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 07:05:05.843000 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:05:05.843201 31150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:05.834073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46219 (local address 127.29.82.65:44433)
0808 07:05:05.834246 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:05.834289 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:05.835199 (+ 910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:05.835458 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:05.835461 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:05.835719 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:05.835929 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:05.835933 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:05.836623 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:05.836624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:05.837512 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:05.837515 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:05.837887 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:05.837888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:05.838007 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:05.838503 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:05.838511 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:05.840098 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:05.841763 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:05.841770 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:05.841773 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:05.841997 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:05.842208 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:05.842209 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:05.842210 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:05.842372 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:05.842653 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:05.842657 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:05.842784 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 07:05:05.842864 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 07:05:05.843000 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
I20260808 07:05:05.843758 31146 heartbeater.cc:347] Connected to a master server at 127.29.82.126:46219
I20260808 07:05:05.843863 31146 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:05.844067 31146 heartbeater.cc:511] Master 127.29.82.126:46219 requested a full tablet report, sending...
I20260808 07:05:05.844650 30867 ts_manager.cc:194] Registered new tserver with Master: 4f12249f2bdb42b699e4603bfc764942 (127.29.82.65:46345)
I20260808 07:05:05.845371 30867 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:44433
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:05:05.868366 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46219
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:38663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:05.951174 31158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:05.951390 31158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:05.951413 31158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:05.952567 31158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:05.952605 31158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:05.952630 31158 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:05:05.954175 31158 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:38663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46219
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:05.954391 31158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:05.954599 31158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:05.959676 31166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:05.959690 31171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:05.959744 31158 server_base.cc:1034] running on GCE node
W20260808 07:05:05.959685 31167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:05.960080 31158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:05.960317 31158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:05.961467 31158 hybrid_clock.cc:648] HybridClock initialized: now 1786172705961447 us; error 37 us; skew 500 ppm
Aug 08 07:05:05 dist-test-slave-rmhg krb5kdc[30804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172705, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:05.964042 31158 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:05:05.964525 31158 webserver.cc:460] Webserver started at http://127.29.82.66:44801/ using document root <none> and password file <none>
I20260808 07:05:05.964751 31158 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:05.964799 31158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:05.964927 31158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:05.966023 31158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2"
format_stamp: "Formatted at 2026-08-08 07:05:05 on dist-test-slave-rmhg"
server_key: "1c19e422384291b7c34484fce06d38d2"
server_key_iv: "5dc661f3572d75c988057d3dbf88dd6b"
server_key_version: "encryptionkey@0"
I20260808 07:05:05.966357 31158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2"
format_stamp: "Formatted at 2026-08-08 07:05:05 on dist-test-slave-rmhg"
server_key: "1c19e422384291b7c34484fce06d38d2"
server_key_iv: "5dc661f3572d75c988057d3dbf88dd6b"
server_key_version: "encryptionkey@0"
I20260808 07:05:05.967621 31158 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:05:05.968291 31183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:05.968447 31158 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:05.968537 31158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2"
format_stamp: "Formatted at 2026-08-08 07:05:05 on dist-test-slave-rmhg"
server_key: "1c19e422384291b7c34484fce06d38d2"
server_key_iv: "5dc661f3572d75c988057d3dbf88dd6b"
server_key_version: "encryptionkey@0"
I20260808 07:05:05.968601 31158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:05.986626 31158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:05.988888 31158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:05.989040 31158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:05.989305 31158 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:05.989650 31158 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:05.989686 31158 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:05.989715 31158 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:05.989732 31158 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:05.995401 31158 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:38525
I20260808 07:05:05.995460 31352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:38525 every 8 connection(s)
I20260808 07:05:05.995782 31158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:05:05 dist-test-slave-rmhg krb5kdc[30804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172705, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:06.004401 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 31158
I20260808 07:05:06.004532 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:06.004722 30025 external_mini_cluster.cc:1428] Setting key 3633ce081268bb9de96eaed6ca4712f8
I20260808 07:05:06.006532 30930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:05.996481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:55619 (local address 127.29.82.126:46219)
0808 07:05:05.996570 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:05.996573 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:05.996740 (+ 167us) server_negotiation.cc:407] Connection header received
0808 07:05:05.997697 (+ 957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:05.997699 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:05.997710 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:05.997763 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:05.998416 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:05.998934 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.000151 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.000477 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.000559 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.003250 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:06.003252 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:06.003252 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:06.003261 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:06.004899 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:06.005395 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:06.005396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:06.005397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:06.005460 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:06.005757 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:06.005758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:06.005759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:06.005917 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:06.005992 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:06.006353 (+ 361us) server_negotiation.cc:299] Negotiation successful
0808 07:05:06.006440 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 07:05:06.006863 31356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:05.996454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46219 (local address 127.29.82.66:55619)
0808 07:05:05.996619 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:05.996657 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:05.997596 (+ 939us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:05.997822 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:05.997826 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:05.998078 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:05.998302 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:05.998307 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:05.999020 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:05.999021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:06.000055 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:06.000058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.000688 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.000689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:06.000888 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.001522 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:06.001533 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:06.003142 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:06.004970 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:06.004979 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:06.004982 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:06.005325 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:06.005526 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:06.005527 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:06.005528 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:06.005695 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:06.006019 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:06.006026 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:06.006196 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 07:05:06.006300 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 07:05:06.006465 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":86,"threads_started":1}
I20260808 07:05:06.008602 31353 heartbeater.cc:347] Connected to a master server at 127.29.82.126:46219
I20260808 07:05:06.008709 31353 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:06.008899 31353 heartbeater.cc:511] Master 127.29.82.126:46219 requested a full tablet report, sending...
I20260808 07:05:06.009294 30867 ts_manager.cc:194] Registered new tserver with Master: 26ad1f1bab9c44959ece05a7e8f6a3e2 (127.29.82.66:38525)
I20260808 07:05:06.009723 30867 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:55619
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:05:06.033973 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46219
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:38663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:06.115212 31360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:06.115417 31360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:06.115438 31360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:06.116537 31360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:06.116570 31360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:06.116595 31360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:05:06.118142 31360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:38663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46219
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:06.118335 31360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:06.118515 31360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:06.123276 31367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:06.123327 31366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:06.123389 31360 server_base.cc:1034] running on GCE node
W20260808 07:05:06.123276 31370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:06.123781 31360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:06.123987 31360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:06.125121 31360 hybrid_clock.cc:648] HybridClock initialized: now 1786172706125106 us; error 36 us; skew 500 ppm
Aug 08 07:05:06 dist-test-slave-rmhg krb5kdc[30804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172706, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:06.127563 31360 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:05:06.127964 31360 webserver.cc:460] Webserver started at http://127.29.82.67:43403/ using document root <none> and password file <none>
I20260808 07:05:06.128181 31360 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:06.128230 31360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:06.128357 31360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:06.129429 31360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "ee37146614cc4256be02ddb00e7c994f"
format_stamp: "Formatted at 2026-08-08 07:05:06 on dist-test-slave-rmhg"
server_key: "841f42498a7ff1bfb40b6e0934b2da13"
server_key_iv: "9ef8b8a714e440d3a35ebe90800f70b8"
server_key_version: "encryptionkey@0"
I20260808 07:05:06.129765 31360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "ee37146614cc4256be02ddb00e7c994f"
format_stamp: "Formatted at 2026-08-08 07:05:06 on dist-test-slave-rmhg"
server_key: "841f42498a7ff1bfb40b6e0934b2da13"
server_key_iv: "9ef8b8a714e440d3a35ebe90800f70b8"
server_key_version: "encryptionkey@0"
I20260808 07:05:06.131042 31360 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:06.131762 31380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:06.131937 31360 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:06.132028 31360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "ee37146614cc4256be02ddb00e7c994f"
format_stamp: "Formatted at 2026-08-08 07:05:06 on dist-test-slave-rmhg"
server_key: "841f42498a7ff1bfb40b6e0934b2da13"
server_key_iv: "9ef8b8a714e440d3a35ebe90800f70b8"
server_key_version: "encryptionkey@0"
I20260808 07:05:06.132087 31360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:06.144352 31360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:06.146642 31360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:06.146839 31360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:06.147055 31360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:06.147363 31360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:06.147403 31360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:06.147423 31360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:06.147434 31360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:06.153076 31360 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:36497
I20260808 07:05:06.153142 31548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:36497 every 8 connection(s)
I20260808 07:05:06.153460 31360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:05:06.159281 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 31360
I20260808 07:05:06.159368 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:06.159516 30025 external_mini_cluster.cc:1428] Setting key ae356863a055db959e2144231e98f039
Aug 08 07:05:06 dist-test-slave-rmhg krb5kdc[30804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172706, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:06.162462 30930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.154221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:33753 (local address 127.29.82.126:46219)
0808 07:05:06.154292 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:06.154294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:06.154472 (+ 178us) server_negotiation.cc:407] Connection header received
0808 07:05:06.155447 (+ 975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:06.155448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:06.155462 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:06.155526 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:06.156220 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.156723 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.157744 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.157936 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.157993 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.160056 (+ 2063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:06.160057 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:06.160058 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:06.160066 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:06.161250 (+ 1184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:06.161594 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:06.161595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:06.161595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:06.161651 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:06.161856 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:06.161857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:06.161857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:06.161972 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:06.162034 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:06.162285 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 07:05:06.162373 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:05:06.162617 31553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.154199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46219 (local address 127.29.82.67:33753)
0808 07:05:06.154358 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:06.154393 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:06.155324 (+ 931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:06.155603 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:06.155607 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:06.155862 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:06.156129 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:06.156135 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.156801 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.156802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:06.157667 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:06.157669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.158011 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.158012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:06.158127 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.158553 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:06.158562 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:06.159972 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:06.161312 (+ 1340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:06.161319 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:06.161321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:06.161530 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:06.161701 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:06.161702 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:06.161702 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:06.161803 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:06.162029 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:06.162036 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:06.162169 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 07:05:06.162256 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 07:05:06.162404 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":75,"threads_started":1}
I20260808 07:05:06.163051 31551 heartbeater.cc:347] Connected to a master server at 127.29.82.126:46219
I20260808 07:05:06.163137 31551 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:06.163281 31551 heartbeater.cc:511] Master 127.29.82.126:46219 requested a full tablet report, sending...
I20260808 07:05:06.163609 30867 ts_manager.cc:194] Registered new tserver with Master: ee37146614cc4256be02ddb00e7c994f (127.29.82.67:36497)
I20260808 07:05:06.163952 30867 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:33753
I20260808 07:05:06.171131 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:05:06.178179 30930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.172625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51188 (local address 127.29.82.126:46219)
0808 07:05:06.172668 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:06.172670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:06.172751 (+ 81us) server_negotiation.cc:407] Connection header received
0808 07:05:06.172799 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:06.172799 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:06.172808 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:06.172850 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:06.173437 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.173918 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.174626 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.174914 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.174975 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.176016 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:06.176018 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:06.176018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:06.176025 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:06.177316 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:06.177611 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:06.177611 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:06.177611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:06.177657 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:06.177774 (+ 117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:06.177774 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:06.177774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:06.177905 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:06.177973 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:06.178049 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 07:05:06.178105 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:05:06.180236 30867 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51188:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:06.181851 30867 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:06.188155 31567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.184125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:38525 (local address 127.0.0.1:51160)
0808 07:05:06.184256 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:06.184297 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:06.184368 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:06.184731 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:06.184734 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:06.184737 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:06.184804 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:06.184806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.185937 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.185938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:06.187101 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:06.187104 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.187892 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.187893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:06.187975 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.187991 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 07:05:06.188045 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 07:05:06.188097 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":58,"threads_started":1}
I20260808 07:05:06.188594 31572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.184508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:36497 (local address 127.0.0.1:38658)
0808 07:05:06.184713 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:06.184722 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:06.184768 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:06.185270 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:06.185271 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:06.185273 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:06.185311 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:06.185312 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.186516 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.186517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:06.187358 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:06.187360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.188334 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.188334 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:06.188403 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.188408 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:05:06.188474 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 07:05:06.188503 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":3,"thread_start_us":61,"threads_started":1}
I20260808 07:05:06.188603 31569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.184314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:46345 (local address 127.0.0.1:34846)
0808 07:05:06.184635 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:06.184644 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:06.184723 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:06.184921 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:06.184922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:06.184924 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:06.184973 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:06.184974 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.186306 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.186307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:06.187414 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:06.187417 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.188333 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.188334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:06.188403 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.188407 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:06.188461 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 07:05:06.188499 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":1,"thread_start_us":69,"threads_started":1}
I20260808 07:05:06.188627 31570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.184460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34846 (local address 127.29.82.65:46345)
0808 07:05:06.184672 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:06.184677 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:06.184779 (+ 102us) server_negotiation.cc:407] Connection header received
0808 07:05:06.184821 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:06.184823 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:06.184838 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:06.184909 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:06.185131 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.186200 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.187478 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.188171 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.188239 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.188297 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:06.188494 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 07:05:06.188548 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":87,"threads_started":1}
I20260808 07:05:06.188655 31568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.184267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51160 (local address 127.29.82.66:38525)
0808 07:05:06.184485 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:06.184490 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:06.184499 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:05:06.184539 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:06.184541 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:06.184556 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:06.184628 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:06.184882 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.185844 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.187198 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.187797 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.188453 (+ 656us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.188524 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:06.188547 (+ 23us) server_negotiation.cc:299] Negotiation successful
0808 07:05:06.188586 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":90,"threads_started":1}
I20260808 07:05:06.188983 31573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.184623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38658 (local address 127.29.82.67:36497)
0808 07:05:06.184945 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:06.184950 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:06.184994 (+ 44us) server_negotiation.cc:407] Connection header received
0808 07:05:06.185064 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:06.185066 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:06.185082 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:06.185180 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:06.185390 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.186387 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.187428 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.188171 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.188239 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.188297 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:06.188869 (+ 572us) server_negotiation.cc:299] Negotiation successful
0808 07:05:06.188909 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":96,"threads_started":1}
I20260808 07:05:06.189497 31054 tablet_service.cc:1467] Processing CreateTablet for tablet 96ff6b4e9e9a49cb9739f222ec59b684 (DEFAULT_TABLE table=test-table [id=e3e38e756cb24950bbfa00edce1755ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:06.189626 31255 tablet_service.cc:1467] Processing CreateTablet for tablet 96ff6b4e9e9a49cb9739f222ec59b684 (DEFAULT_TABLE table=test-table [id=e3e38e756cb24950bbfa00edce1755ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:06.189802 31054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ff6b4e9e9a49cb9739f222ec59b684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:06.189800 31456 tablet_service.cc:1467] Processing CreateTablet for tablet 96ff6b4e9e9a49cb9739f222ec59b684 (DEFAULT_TABLE table=test-table [id=e3e38e756cb24950bbfa00edce1755ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:06.189951 31255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ff6b4e9e9a49cb9739f222ec59b684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:06.190085 31456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ff6b4e9e9a49cb9739f222ec59b684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:06.192185 31574 tablet_bootstrap.cc:492] T 96ff6b4e9e9a49cb9739f222ec59b684 P 4f12249f2bdb42b699e4603bfc764942: Bootstrap starting.
I20260808 07:05:06.192754 31574 tablet_bootstrap.cc:654] T 96ff6b4e9e9a49cb9739f222ec59b684 P 4f12249f2bdb42b699e4603bfc764942: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:06.193076 31577 tablet_bootstrap.cc:492] T 96ff6b4e9e9a49cb9739f222ec59b684 P ee37146614cc4256be02ddb00e7c994f: Bootstrap starting.
I20260808 07:05:06.193696 31574 log.cc:824] T 96ff6b4e9e9a49cb9739f222ec59b684 P 4f12249f2bdb42b699e4603bfc764942: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:06.193794 31577 tablet_bootstrap.cc:654] T 96ff6b4e9e9a49cb9739f222ec59b684 P ee37146614cc4256be02ddb00e7c994f: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:06.194099 31576 tablet_bootstrap.cc:492] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2: Bootstrap starting.
I20260808 07:05:06.194324 31577 log.cc:824] T 96ff6b4e9e9a49cb9739f222ec59b684 P ee37146614cc4256be02ddb00e7c994f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:06.194432 31574 tablet_bootstrap.cc:492] T 96ff6b4e9e9a49cb9739f222ec59b684 P 4f12249f2bdb42b699e4603bfc764942: No bootstrap required, opened a new log
I20260808 07:05:06.194512 31574 ts_tablet_manager.cc:1397] T 96ff6b4e9e9a49cb9739f222ec59b684 P 4f12249f2bdb42b699e4603bfc764942: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:05:06.194708 31576 tablet_bootstrap.cc:654] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:06.195178 31577 tablet_bootstrap.cc:492] T 96ff6b4e9e9a49cb9739f222ec59b684 P ee37146614cc4256be02ddb00e7c994f: No bootstrap required, opened a new log
I20260808 07:05:06.195231 31576 log.cc:824] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:06.195250 31577 ts_tablet_manager.cc:1397] T 96ff6b4e9e9a49cb9739f222ec59b684 P ee37146614cc4256be02ddb00e7c994f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:05:06.195976 31576 tablet_bootstrap.cc:492] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2: No bootstrap required, opened a new log
I20260808 07:05:06.196058 31576 ts_tablet_manager.cc:1397] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:06.196382 31574 raft_consensus.cc:348] T 96ff6b4e9e9a49cb9739f222ec59b684 P 4f12249f2bdb42b699e4603bfc764942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 38525 } } peers { permanent_uuid: "4f12249f2bdb42b699e4603bfc764942" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 46345 } } peers { permanent_uuid: "ee37146614cc4256be02ddb00e7c994f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36497 } }
I20260808 07:05:06.196538 31574 raft_consensus.cc:374] T 96ff6b4e9e9a49cb9739f222ec59b684 P 4f12249f2bdb42b699e4603bfc764942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:06.196573 31574 raft_consensus.cc:729] T 96ff6b4e9e9a49cb9739f222ec59b684 P 4f12249f2bdb42b699e4603bfc764942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f12249f2bdb42b699e4603bfc764942, State: Initialized, Role: FOLLOWER
I20260808 07:05:06.196692 31574 consensus_queue.cc:260] T 96ff6b4e9e9a49cb9739f222ec59b684 P 4f12249f2bdb42b699e4603bfc764942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 38525 } } peers { permanent_uuid: "4f12249f2bdb42b699e4603bfc764942" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 46345 } } peers { permanent_uuid: "ee37146614cc4256be02ddb00e7c994f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36497 } }
I20260808 07:05:06.196957 31574 ts_tablet_manager.cc:1428] T 96ff6b4e9e9a49cb9739f222ec59b684 P 4f12249f2bdb42b699e4603bfc764942: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:05:06.197084 31146 heartbeater.cc:503] Master 127.29.82.126:46219 was elected leader, sending a full tablet report...
I20260808 07:05:06.197383 31577 raft_consensus.cc:348] T 96ff6b4e9e9a49cb9739f222ec59b684 P ee37146614cc4256be02ddb00e7c994f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 38525 } } peers { permanent_uuid: "4f12249f2bdb42b699e4603bfc764942" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 46345 } } peers { permanent_uuid: "ee37146614cc4256be02ddb00e7c994f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36497 } }
I20260808 07:05:06.197567 31577 raft_consensus.cc:374] T 96ff6b4e9e9a49cb9739f222ec59b684 P ee37146614cc4256be02ddb00e7c994f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:06.197609 31577 raft_consensus.cc:729] T 96ff6b4e9e9a49cb9739f222ec59b684 P ee37146614cc4256be02ddb00e7c994f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee37146614cc4256be02ddb00e7c994f, State: Initialized, Role: FOLLOWER
I20260808 07:05:06.197723 31577 consensus_queue.cc:260] T 96ff6b4e9e9a49cb9739f222ec59b684 P ee37146614cc4256be02ddb00e7c994f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 38525 } } peers { permanent_uuid: "4f12249f2bdb42b699e4603bfc764942" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 46345 } } peers { permanent_uuid: "ee37146614cc4256be02ddb00e7c994f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36497 } }
I20260808 07:05:06.197988 31577 ts_tablet_manager.cc:1428] T 96ff6b4e9e9a49cb9739f222ec59b684 P ee37146614cc4256be02ddb00e7c994f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:05:06.198004 31551 heartbeater.cc:503] Master 127.29.82.126:46219 was elected leader, sending a full tablet report...
I20260808 07:05:06.198067 31576 raft_consensus.cc:348] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 38525 } } peers { permanent_uuid: "4f12249f2bdb42b699e4603bfc764942" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 46345 } } peers { permanent_uuid: "ee37146614cc4256be02ddb00e7c994f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36497 } }
I20260808 07:05:06.198233 31576 raft_consensus.cc:374] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:06.198275 31576 raft_consensus.cc:729] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26ad1f1bab9c44959ece05a7e8f6a3e2, State: Initialized, Role: FOLLOWER
I20260808 07:05:06.198391 31576 consensus_queue.cc:260] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 38525 } } peers { permanent_uuid: "4f12249f2bdb42b699e4603bfc764942" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 46345 } } peers { permanent_uuid: "ee37146614cc4256be02ddb00e7c994f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36497 } }
I20260808 07:05:06.198663 31576 ts_tablet_manager.cc:1428] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:05:06.198674 31353 heartbeater.cc:503] Master 127.29.82.126:46219 was elected leader, sending a full tablet report...
W20260808 07:05:06.246335 31354 tablet.cc:2369] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:06.274907 31585 raft_consensus.cc:482] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:06.275063 31585 raft_consensus.cc:504] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 38525 } } peers { permanent_uuid: "4f12249f2bdb42b699e4603bfc764942" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 46345 } } peers { permanent_uuid: "ee37146614cc4256be02ddb00e7c994f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36497 } }
I20260808 07:05:06.275455 31585 leader_election.cc:288] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f12249f2bdb42b699e4603bfc764942 (127.29.82.65:46345), ee37146614cc4256be02ddb00e7c994f (127.29.82.67:36497)
I20260808 07:05:06.278388 31570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.275862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:56711 (local address 127.29.82.65:46345)
0808 07:05:06.275904 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:06.275906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:06.275917 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:05:06.275948 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:06.275949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:06.275960 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:06.276053 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:06.276222 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.276702 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.277681 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.278069 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.278134 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.278144 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:06.278281 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 07:05:06.278317 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:05:06.278398 31573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.275895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:56369 (local address 127.29.82.67:36497)
0808 07:05:06.275964 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:06.275967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:06.276057 (+ 90us) server_negotiation.cc:407] Connection header received
0808 07:05:06.276110 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:06.276111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:06.276123 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:06.276167 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:06.276304 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.276771 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.277719 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.278094 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.278157 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.278166 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:06.278294 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 07:05:06.278331 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 07:05:06.278391 31356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.275684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:46345 (local address 127.29.82.66:56711)
0808 07:05:06.275745 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:06.275757 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:06.275804 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:06.276060 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:06.276062 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:06.276064 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:06.276150 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:06.276152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.276781 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.276781 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:06.277586 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:06.277588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.278144 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.278146 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:06.278217 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.278220 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:06.278266 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:05:06.278310 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":1}
I20260808 07:05:06.278410 31586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.275804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:36497 (local address 127.29.82.66:56369)
0808 07:05:06.275980 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:06.275988 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:06.276051 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:06.276183 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:06.276183 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:06.276185 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:06.276249 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:06.276250 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.276846 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.276847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:06.277640 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:06.277642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.278171 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.278172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:06.278236 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.278239 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:06.278283 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:05:06.278322 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":121,"threads_started":1}
I20260808 07:05:06.278812 31082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ff6b4e9e9a49cb9739f222ec59b684" candidate_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f12249f2bdb42b699e4603bfc764942" is_pre_election: true
I20260808 07:05:06.278995 31082 raft_consensus.cc:2454] T 96ff6b4e9e9a49cb9739f222ec59b684 P 4f12249f2bdb42b699e4603bfc764942 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26ad1f1bab9c44959ece05a7e8f6a3e2 in term 0.
I20260808 07:05:06.279105 31480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ff6b4e9e9a49cb9739f222ec59b684" candidate_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee37146614cc4256be02ddb00e7c994f" is_pre_election: true
I20260808 07:05:06.279253 31480 raft_consensus.cc:2454] T 96ff6b4e9e9a49cb9739f222ec59b684 P ee37146614cc4256be02ddb00e7c994f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26ad1f1bab9c44959ece05a7e8f6a3e2 in term 0.
I20260808 07:05:06.279234 31184 leader_election.cc:302] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26ad1f1bab9c44959ece05a7e8f6a3e2, 4f12249f2bdb42b699e4603bfc764942; no voters:
I20260808 07:05:06.279372 31585 raft_consensus.cc:2781] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:06.279417 31585 raft_consensus.cc:482] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:06.279440 31585 raft_consensus.cc:3037] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:06.280328 31585 raft_consensus.cc:504] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 38525 } } peers { permanent_uuid: "4f12249f2bdb42b699e4603bfc764942" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 46345 } } peers { permanent_uuid: "ee37146614cc4256be02ddb00e7c994f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36497 } }
I20260808 07:05:06.280462 31585 leader_election.cc:288] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [CANDIDATE]: Term 1 election: Requested vote from peers 4f12249f2bdb42b699e4603bfc764942 (127.29.82.65:46345), ee37146614cc4256be02ddb00e7c994f (127.29.82.67:36497)
I20260808 07:05:06.280628 31082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ff6b4e9e9a49cb9739f222ec59b684" candidate_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f12249f2bdb42b699e4603bfc764942"
I20260808 07:05:06.280658 31480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ff6b4e9e9a49cb9739f222ec59b684" candidate_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee37146614cc4256be02ddb00e7c994f"
I20260808 07:05:06.280704 31082 raft_consensus.cc:3037] T 96ff6b4e9e9a49cb9739f222ec59b684 P 4f12249f2bdb42b699e4603bfc764942 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:06.280736 31480 raft_consensus.cc:3037] T 96ff6b4e9e9a49cb9739f222ec59b684 P ee37146614cc4256be02ddb00e7c994f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:06.281441 31082 raft_consensus.cc:2454] T 96ff6b4e9e9a49cb9739f222ec59b684 P 4f12249f2bdb42b699e4603bfc764942 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26ad1f1bab9c44959ece05a7e8f6a3e2 in term 1.
I20260808 07:05:06.281570 31480 raft_consensus.cc:2454] T 96ff6b4e9e9a49cb9739f222ec59b684 P ee37146614cc4256be02ddb00e7c994f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26ad1f1bab9c44959ece05a7e8f6a3e2 in term 1.
I20260808 07:05:06.281635 31184 leader_election.cc:302] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26ad1f1bab9c44959ece05a7e8f6a3e2, 4f12249f2bdb42b699e4603bfc764942; no voters:
I20260808 07:05:06.281749 31585 raft_consensus.cc:2781] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:06.281905 31585 raft_consensus.cc:686] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [term 1 LEADER]: Becoming Leader. State: Replica: 26ad1f1bab9c44959ece05a7e8f6a3e2, State: Running, Role: LEADER
I20260808 07:05:06.282001 31585 consensus_queue.cc:237] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 38525 } } peers { permanent_uuid: "4f12249f2bdb42b699e4603bfc764942" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 46345 } } peers { permanent_uuid: "ee37146614cc4256be02ddb00e7c994f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36497 } }
I20260808 07:05:06.282935 30867 catalog_manager.cc:5495] T 96ff6b4e9e9a49cb9739f222ec59b684 P 26ad1f1bab9c44959ece05a7e8f6a3e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26ad1f1bab9c44959ece05a7e8f6a3e2 (127.29.82.66). New cstate: current_term: 1 leader_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26ad1f1bab9c44959ece05a7e8f6a3e2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 38525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f12249f2bdb42b699e4603bfc764942" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 46345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee37146614cc4256be02ddb00e7c994f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36497 } health_report { overall_health: UNKNOWN } } }
Aug 08 07:05:06 dist-test-slave-rmhg krb5kdc[30804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.65@KRBTEST.COM
I20260808 07:05:06.312034 31570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.304740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34852 (local address 127.29.82.65:46345)
0808 07:05:06.304789 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:06.304791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:06.304852 (+ 61us) server_negotiation.cc:407] Connection header received
0808 07:05:06.304912 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:06.304913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:06.304922 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:06.304960 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:06.305549 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.306038 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.306718 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.306911 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.306961 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.309237 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:06.309251 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:06.309251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:06.309259 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:06.310938 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:06.311285 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:06.311287 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:06.311288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:06.311340 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:06.311546 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:06.311547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:06.311547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:06.311683 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:06.311792 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:06.311882 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 07:05:06.311960 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
Aug 08 07:05:06 dist-test-slave-rmhg krb5kdc[30804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172706, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:05:06 dist-test-slave-rmhg krb5kdc[30804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172706, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.82.65@KRBTEST.COM
W20260808 07:05:06.334152 31148 tablet.cc:2369] T 96ff6b4e9e9a49cb9739f222ec59b684 P 4f12249f2bdb42b699e4603bfc764942: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:06.336201 31570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.329231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34856 (local address 127.29.82.65:46345)
0808 07:05:06.329300 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:06.329302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:06.329342 (+ 40us) server_negotiation.cc:407] Connection header received
0808 07:05:06.329434 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:06.329435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:06.329447 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:06.329493 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:06.330045 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.330538 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.331334 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.331541 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.331601 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.333790 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:06.333792 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:06.333792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:06.333799 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:06.335089 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:06.335418 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:06.335418 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:06.335419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:06.335465 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:06.335666 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:06.335666 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:06.335667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:06.335759 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:06.335827 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:06.336074 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 07:05:06.336135 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
Aug 08 07:05:06 dist-test-slave-rmhg krb5kdc[30804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:05:06 dist-test-slave-rmhg krb5kdc[30804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.65@KRBTEST.COM
I20260808 07:05:06.359577 31570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:06.352565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34862 (local address 127.29.82.65:46345)
0808 07:05:06.352629 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:06.352631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:06.352723 (+ 92us) server_negotiation.cc:407] Connection header received
0808 07:05:06.352799 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:06.352800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:06.352812 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:06.352860 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:06.353469 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.353943 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.354680 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:06.354866 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:06.354920 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:06.357212 (+ 2292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:06.357215 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:06.357215 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:06.357224 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:06.358532 (+ 1308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:06.358864 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:06.358866 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:06.358866 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:06.358922 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:06.359091 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:06.359091 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:06.359092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:06.359190 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:06.359277 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:06.359390 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 07:05:06.359478 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260808 07:05:06.360057 31021 tablet_service.cc:2908] Rejecting scan request for tablet 96ff6b4e9e9a49cb9739f222ec59b684: Uninitialized: clean time has not yet been initialized
I20260808 07:05:06.360908 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 30961
I20260808 07:05:06.372591 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 31158
I20260808 07:05:06.385506 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 31360
I20260808 07:05:06.395223 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 30819
2026-08-08T07:05:06Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2131 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:06 dist-test-slave-rmhg krb5kdc[31609](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:06 dist-test-slave-rmhg krb5kdc[31609](info): set up 2 sockets
Aug 08 07:05:06 dist-test-slave-rmhg krb5kdc[31609](info): commencing operation
krb5kdc: starting...
W20260808 07:05:07.527614 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:05:07 dist-test-slave-rmhg krb5kdc[31609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:05:07.648895 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:45925
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:45925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:07.731441 31629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:07.731650 31629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:07.731679 31629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:07.732822 31629 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:07.732864 31629 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 07:05:07.732882 31629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:07.732897 31629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:07.732913 31629 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:07.732929 31629 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:07.734496 31629 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:45925
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:45925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:07.734748 31629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:07.734959 31629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:07.739745 31637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:07.739853 31629 server_base.cc:1034] running on GCE node
W20260808 07:05:07.739931 31641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:07.739776 31638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:07.740227 31629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:07.740485 31629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:07.741637 31629 hybrid_clock.cc:648] HybridClock initialized: now 1786172707741612 us; error 44 us; skew 500 ppm
Aug 08 07:05:07 dist-test-slave-rmhg krb5kdc[31609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172707, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:07.746778 31629 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:05:07.747231 31629 webserver.cc:460] Webserver started at http://127.29.82.126:37347/ using document root <none> and password file <none>
I20260808 07:05:07.747439 31629 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:07.747489 31629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:07.747625 31629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:07.748695 31629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "a51c56e34a3f4de4ae25339111756700"
format_stamp: "Formatted at 2026-08-08 07:05:07 on dist-test-slave-rmhg"
server_key: "e1ba0f3d57dfb7c9cffac5944eff3166"
server_key_iv: "a50180a32def3dda4171960ef2ecb5cb"
server_key_version: "encryptionkey@0"
I20260808 07:05:07.749038 31629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "a51c56e34a3f4de4ae25339111756700"
format_stamp: "Formatted at 2026-08-08 07:05:07 on dist-test-slave-rmhg"
server_key: "e1ba0f3d57dfb7c9cffac5944eff3166"
server_key_iv: "a50180a32def3dda4171960ef2ecb5cb"
server_key_version: "encryptionkey@0"
I20260808 07:05:07.750413 31629 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:05:07.751147 31648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:07.751300 31629 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:07.751391 31629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "a51c56e34a3f4de4ae25339111756700"
format_stamp: "Formatted at 2026-08-08 07:05:07 on dist-test-slave-rmhg"
server_key: "e1ba0f3d57dfb7c9cffac5944eff3166"
server_key_iv: "a50180a32def3dda4171960ef2ecb5cb"
server_key_version: "encryptionkey@0"
I20260808 07:05:07.751454 31629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:07.783529 31629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:07.785918 31629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:07.786087 31629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:07.790647 31629 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:45925
I20260808 07:05:07.790727 31727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:45925 every 8 connection(s)
I20260808 07:05:07.791039 31629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:07.791792 31728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:07.794181 31728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700: Bootstrap starting.
I20260808 07:05:07.794564 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 31629
I20260808 07:05:07.794659 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:07.794816 30025 external_mini_cluster.cc:1428] Setting key cb9025177df59de3e5d0efbe64d51b4c
I20260808 07:05:07.794885 31728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:07.795190 31728 log.cc:824] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:07.796082 31728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700: No bootstrap required, opened a new log
I20260808 07:05:07.797948 31728 raft_consensus.cc:348] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a51c56e34a3f4de4ae25339111756700" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45925 } }
I20260808 07:05:07.798099 31728 raft_consensus.cc:374] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:07.798136 31728 raft_consensus.cc:729] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a51c56e34a3f4de4ae25339111756700, State: Initialized, Role: FOLLOWER
I20260808 07:05:07.798267 31728 consensus_queue.cc:260] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a51c56e34a3f4de4ae25339111756700" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45925 } }
I20260808 07:05:07.798341 31728 raft_consensus.cc:388] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:07.798382 31728 raft_consensus.cc:482] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:07.798445 31728 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:07.798957 31728 raft_consensus.cc:504] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a51c56e34a3f4de4ae25339111756700" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45925 } }
I20260808 07:05:07.799065 31728 leader_election.cc:302] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a51c56e34a3f4de4ae25339111756700; no voters:
I20260808 07:05:07.799233 31728 leader_election.cc:288] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:07.799281 31734 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:07.799425 31734 raft_consensus.cc:686] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [term 1 LEADER]: Becoming Leader. State: Replica: a51c56e34a3f4de4ae25339111756700, State: Running, Role: LEADER
I20260808 07:05:07.799502 31728 sys_catalog.cc:564] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:07.799507 31734 consensus_queue.cc:237] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a51c56e34a3f4de4ae25339111756700" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45925 } }
I20260808 07:05:07.799957 31735 sys_catalog.cc:455] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a51c56e34a3f4de4ae25339111756700" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a51c56e34a3f4de4ae25339111756700" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45925 } } }
I20260808 07:05:07.800042 31735 sys_catalog.cc:458] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:07.800216 31739 sys_catalog.cc:455] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a51c56e34a3f4de4ae25339111756700. Latest consensus state: current_term: 1 leader_uuid: "a51c56e34a3f4de4ae25339111756700" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a51c56e34a3f4de4ae25339111756700" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45925 } } }
I20260808 07:05:07.800444 31739 sys_catalog.cc:458] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:07.800583 31750 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:07.801059 31750 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 07:05:07 dist-test-slave-rmhg krb5kdc[31609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:07.803995 31750 catalog_manager.cc:1347] Generated new cluster ID: 7d547994a29142a3a213925fc8c40fa0
I20260808 07:05:07.804054 31750 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:07.805687 31732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:07.795359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42072 (local address 127.29.82.126:45925)
0808 07:05:07.795565 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:07.795574 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:07.795601 (+ 27us) server_negotiation.cc:407] Connection header received
0808 07:05:07.796042 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:07.796049 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:07.796095 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:07.796275 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:07.796893 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:07.797835 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:07.798728 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:07.799198 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:07.799305 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:07.802243 (+ 2938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:07.802248 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:07.802248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:07.802261 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:07.803828 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:07.804234 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:07.804237 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:07.804237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:07.804336 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:07.804544 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:07.804545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:07.804545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:07.804817 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:07.804948 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:07.805074 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 07:05:07.805230 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":90,"threads_started":1}
I20260808 07:05:07.814332 31750 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:07.815058 31750 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:07.822300 31750 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700: Generated new TSK 0
I20260808 07:05:07.822494 31750 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:05:07.852274 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45925
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:07.935622 31769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:07.935833 31769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:07.935866 31769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:07.937086 31769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:07.937132 31769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:07.937180 31769 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:05:07.937206 31769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:05:07.938644 31769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.82.126:45925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:07.938868 31769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:07.939071 31769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:07.943862 31779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:07.943871 31784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:07.943872 31786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:07.944193 31769 server_base.cc:1034] running on GCE node
I20260808 07:05:07.944434 31769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:07.944701 31769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:07.945834 31769 hybrid_clock.cc:648] HybridClock initialized: now 1786172707945825 us; error 33 us; skew 500 ppm
Aug 08 07:05:07 dist-test-slave-rmhg krb5kdc[31609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172707, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:07.948287 31769 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:05:07.948735 31769 webserver.cc:460] Webserver started at http://127.29.82.65:39045/ using document root <none> and password file <none>
I20260808 07:05:07.948938 31769 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:07.948987 31769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:07.949119 31769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:07.950169 31769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "7e0e3ce51dae4881a03da5299c059eb4"
format_stamp: "Formatted at 2026-08-08 07:05:07 on dist-test-slave-rmhg"
server_key: "ae22d3c013612a9f3360243f5bbecfef"
server_key_iv: "1f66c939d51351960f45d0517613fcfa"
server_key_version: "encryptionkey@0"
I20260808 07:05:07.950510 31769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "7e0e3ce51dae4881a03da5299c059eb4"
format_stamp: "Formatted at 2026-08-08 07:05:07 on dist-test-slave-rmhg"
server_key: "ae22d3c013612a9f3360243f5bbecfef"
server_key_iv: "1f66c939d51351960f45d0517613fcfa"
server_key_version: "encryptionkey@0"
I20260808 07:05:07.951805 31769 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:07.952576 31799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:07.952755 31769 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:07.952847 31769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "7e0e3ce51dae4881a03da5299c059eb4"
format_stamp: "Formatted at 2026-08-08 07:05:07 on dist-test-slave-rmhg"
server_key: "ae22d3c013612a9f3360243f5bbecfef"
server_key_iv: "1f66c939d51351960f45d0517613fcfa"
server_key_version: "encryptionkey@0"
I20260808 07:05:07.952907 31769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:07.975981 31769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:07.978094 31769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:07.978245 31769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:07.978806 31769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:07.978852 31769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:07.978886 31769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:07.978904 31769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:07.985953 31769 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:37953
I20260808 07:05:07.986019 31956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:37953 every 8 connection(s)
Aug 08 07:05:07 dist-test-slave-rmhg krb5kdc[31609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172707, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:07.986361 31769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:05:07.988224 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 31769
I20260808 07:05:07.988320 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:07.988544 30025 external_mini_cluster.cc:1428] Setting key 8408f9ea394b00b5194a0e157194e5c5
I20260808 07:05:07.989080 31732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:07.979355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:34333 (local address 127.29.82.126:45925)
0808 07:05:07.979410 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:07.979412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:07.979710 (+ 298us) server_negotiation.cc:407] Connection header received
0808 07:05:07.980243 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:07.980245 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:07.980259 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:07.980323 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:07.981326 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:07.982118 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:07.983657 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:07.983977 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:07.984043 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:07.986601 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:07.986603 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:07.986603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:07.986612 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:07.987754 (+ 1142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:07.988139 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:07.988140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:07.988140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:07.988197 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:07.988428 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:07.988430 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:07.988430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:07.988551 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:07.988609 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:07.988927 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 07:05:07.989007 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:05:07.989310 31812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:07.979345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45925 (local address 127.29.82.65:34333)
0808 07:05:07.979576 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:07.979615 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:07.980130 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:07.980452 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:07.980458 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:07.980847 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:07.981208 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:07.981216 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:07.982237 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:07.982238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:07.983571 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:07.983575 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:07.984071 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:07.984072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:07.984229 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:07.984839 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:07.984848 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:07.986486 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:07.987831 (+ 1345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:07.987838 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:07.987840 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:07.988072 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:07.988251 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:07.988251 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:07.988252 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:07.988377 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:07.988608 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:07.988615 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:07.988775 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 07:05:07.988885 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 07:05:07.989055 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":97,"threads_started":1}
I20260808 07:05:07.989739 31957 heartbeater.cc:347] Connected to a master server at 127.29.82.126:45925
I20260808 07:05:07.989827 31957 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:07.990011 31957 heartbeater.cc:511] Master 127.29.82.126:45925 requested a full tablet report, sending...
I20260808 07:05:07.990548 31666 ts_manager.cc:194] Registered new tserver with Master: 7e0e3ce51dae4881a03da5299c059eb4 (127.29.82.65:37953)
I20260808 07:05:07.991441 31666 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:34333
I20260808 07:05:07.996274 31732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:07.990882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:47725 (local address 127.29.82.126:45925)
0808 07:05:07.990922 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:07.990924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:07.990999 (+ 75us) server_negotiation.cc:407] Connection header received
0808 07:05:07.991056 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:07.991057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:07.991067 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:07.991126 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:07.991489 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:07.992169 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:07.992850 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:07.993040 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:07.993095 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:07.994028 (+ 933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:07.994029 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:07.994030 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:07.994037 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:07.995244 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:07.995615 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:07.995616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:07.995616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:07.995670 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:07.995858 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:07.995859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:07.995859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:07.995950 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:07.995993 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:07.996151 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 07:05:07.996211 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:05:07.996342 31965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:07.990813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45925 (local address 127.29.82.65:47725)
0808 07:05:07.990949 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:07.990959 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:07.991009 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:07.991128 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:07.991129 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:07.991315 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:07.991379 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:07.991381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:07.992262 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:07.992263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:07.992775 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:07.992776 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:07.993099 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:07.993100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:07.993194 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:07.993572 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:07.993577 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:07.993927 (+ 350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:07.995324 (+ 1397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:07.995325 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:07.995326 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:07.995540 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:07.995728 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:07.995729 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:07.995729 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:07.995801 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:07.996002 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:07.996003 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:07.996056 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 07:05:07.996135 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 07:05:07.996241 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":69,"threads_started":1}
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:05:08.016820 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45925
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:08.099033 31967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:08.099236 31967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:08.099259 31967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:08.100485 31967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:08.100524 31967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:08.100544 31967 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:05:08.100560 31967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:05:08.102066 31967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.82.126:45925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:08.102267 31967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:08.102442 31967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:08.107167 31974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:08.107229 31979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:08.107229 31976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:08.107324 31967 server_base.cc:1034] running on GCE node
I20260808 07:05:08.107633 31967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:08.107859 31967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:08.108995 31967 hybrid_clock.cc:648] HybridClock initialized: now 1786172708108980 us; error 37 us; skew 500 ppm
Aug 08 07:05:08 dist-test-slave-rmhg krb5kdc[31609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172708, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:08.111474 31967 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:05:08.111913 31967 webserver.cc:460] Webserver started at http://127.29.82.66:36211/ using document root <none> and password file <none>
I20260808 07:05:08.112136 31967 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:08.112178 31967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:08.112274 31967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:08.113317 31967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "36b21d184dc04fad8412c9165ceb278e"
format_stamp: "Formatted at 2026-08-08 07:05:08 on dist-test-slave-rmhg"
server_key: "5ffcaedb1fd0bfaaf9822625353a465f"
server_key_iv: "5a3221291ab95b62f53053bba3a81284"
server_key_version: "encryptionkey@0"
I20260808 07:05:08.113628 31967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "36b21d184dc04fad8412c9165ceb278e"
format_stamp: "Formatted at 2026-08-08 07:05:08 on dist-test-slave-rmhg"
server_key: "5ffcaedb1fd0bfaaf9822625353a465f"
server_key_iv: "5a3221291ab95b62f53053bba3a81284"
server_key_version: "encryptionkey@0"
I20260808 07:05:08.114840 31967 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:08.115496 31995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:08.115686 31967 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:08.115780 31967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "36b21d184dc04fad8412c9165ceb278e"
format_stamp: "Formatted at 2026-08-08 07:05:08 on dist-test-slave-rmhg"
server_key: "5ffcaedb1fd0bfaaf9822625353a465f"
server_key_iv: "5a3221291ab95b62f53053bba3a81284"
server_key_version: "encryptionkey@0"
I20260808 07:05:08.115844 31967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:08.145068 31967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:08.147360 31967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:08.147482 31967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:08.148061 31967 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:08.148110 31967 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:08.148135 31967 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:08.148159 31967 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:05:08 dist-test-slave-rmhg krb5kdc[31609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172708, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:08.154732 31967 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:45297
I20260808 07:05:08.154824 32166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:45297 every 8 connection(s)
I20260808 07:05:08.155125 31967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:05:08.157648 31732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.148541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:38587 (local address 127.29.82.126:45925)
0808 07:05:08.148594 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.148597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.148823 (+ 226us) server_negotiation.cc:407] Connection header received
0808 07:05:08.149348 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.149350 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.149365 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.149435 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:08.150281 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.151045 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.152515 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.152790 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.152852 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.155168 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:08.155170 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:08.155170 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:08.155178 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:08.156492 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.156893 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.156894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.156894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.156947 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.157122 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.157122 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.157122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.157252 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:08.157299 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.157519 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.157582 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:05:08.157817 32005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.148541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45925 (local address 127.29.82.66:38587)
0808 07:05:08.148706 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.148743 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.149251 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.149548 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.149552 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.149889 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:08.150181 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.150187 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.151137 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.151138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.152419 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.152422 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.152866 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.152866 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.153006 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.153503 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:08.153515 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:08.155048 (+ 1533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:08.156558 (+ 1510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:08.156563 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:08.156565 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:08.156831 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:08.156988 (+ 157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:08.156989 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:08.156989 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:08.157078 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:08.157299 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:08.157302 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:08.157420 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.157502 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.157637 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":95,"threads_started":1}
I20260808 07:05:08.158362 32167 heartbeater.cc:347] Connected to a master server at 127.29.82.126:45925
I20260808 07:05:08.158454 32167 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:08.158625 32167 heartbeater.cc:511] Master 127.29.82.126:45925 requested a full tablet report, sending...
I20260808 07:05:08.159009 31667 ts_manager.cc:194] Registered new tserver with Master: 36b21d184dc04fad8412c9165ceb278e (127.29.82.66:45297)
I20260808 07:05:08.159468 31667 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:38587
I20260808 07:05:08.162791 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 31967
I20260808 07:05:08.162899 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:08.163144 30025 external_mini_cluster.cc:1428] Setting key 75d684f135fa9580d3a80c0f1f106c75
I20260808 07:05:08.164817 32176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.159295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45925 (local address 127.29.82.66:55127)
0808 07:05:08.159424 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.159435 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.159478 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.159681 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.159682 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.159880 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:08.159947 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.159950 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.160564 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.160564 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.161045 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.161046 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.161396 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.161396 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.161453 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.161783 (+ 330us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:08.161787 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:08.162037 (+ 250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:08.163804 (+ 1767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:08.163805 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:08.163805 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:08.163974 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:08.164187 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:08.164187 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:08.164188 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:08.164251 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:08.164581 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:08.164582 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:08.164618 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.164662 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.164743 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":75,"threads_started":1}
I20260808 07:05:08.164855 31732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.159349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:55127 (local address 127.29.82.126:45925)
0808 07:05:08.159587 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.159589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.159597 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:08.159614 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.159615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.159624 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.159671 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:08.160033 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.160489 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.161109 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.161345 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.161392 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.162169 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:08.162170 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:08.162170 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:08.162177 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:08.163656 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.164039 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.164040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.164041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.164101 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.164310 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.164311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.164311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.164514 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:08.164582 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.164702 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.164772 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219}
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:05:08.187844 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45925
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:08.270095 32182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:08.270304 32182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:08.270335 32182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:08.271497 32182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:08.271538 32182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:08.271564 32182 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:05:08.271587 32182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:05:08.273008 32182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.82.126:45925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:08.273268 32182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:08.273475 32182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:08.278296 32195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:08.278276 32191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:08.278481 32193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:08.278523 32182 server_base.cc:1034] running on GCE node
I20260808 07:05:08.278743 32182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:08.278947 32182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:08.280102 32182 hybrid_clock.cc:648] HybridClock initialized: now 1786172708280088 us; error 29 us; skew 500 ppm
Aug 08 07:05:08 dist-test-slave-rmhg krb5kdc[31609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172708, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:08.282517 32182 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:05:08.282950 32182 webserver.cc:460] Webserver started at http://127.29.82.67:44911/ using document root <none> and password file <none>
I20260808 07:05:08.283154 32182 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:08.283202 32182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:08.283331 32182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:08.284480 32182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "3462e89a0c094a3fb3c4684116c4630c"
format_stamp: "Formatted at 2026-08-08 07:05:08 on dist-test-slave-rmhg"
server_key: "c90bc3df1df8efac5faa15528aadcdd7"
server_key_iv: "8a189b0e67882f5ba1409a249df8378d"
server_key_version: "encryptionkey@0"
I20260808 07:05:08.284824 32182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "3462e89a0c094a3fb3c4684116c4630c"
format_stamp: "Formatted at 2026-08-08 07:05:08 on dist-test-slave-rmhg"
server_key: "c90bc3df1df8efac5faa15528aadcdd7"
server_key_iv: "8a189b0e67882f5ba1409a249df8378d"
server_key_version: "encryptionkey@0"
I20260808 07:05:08.286167 32182 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:08.286844 32204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:08.286996 32182 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:08.287102 32182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "3462e89a0c094a3fb3c4684116c4630c"
format_stamp: "Formatted at 2026-08-08 07:05:08 on dist-test-slave-rmhg"
server_key: "c90bc3df1df8efac5faa15528aadcdd7"
server_key_iv: "8a189b0e67882f5ba1409a249df8378d"
server_key_version: "encryptionkey@0"
I20260808 07:05:08.287168 32182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:08.306463 32182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:08.308665 32182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:08.308784 32182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:08.309335 32182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:08.309379 32182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:08.309401 32182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:08.309412 32182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:05:08 dist-test-slave-rmhg krb5kdc[31609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172708, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:08.316473 32182 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:42841
I20260808 07:05:08.316792 32378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:42841 every 8 connection(s)
I20260808 07:05:08.316828 32182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:05:08.319089 31732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.309788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:54215 (local address 127.29.82.126:45925)
0808 07:05:08.309855 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.309857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.310103 (+ 246us) server_negotiation.cc:407] Connection header received
0808 07:05:08.310776 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.310777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.310789 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.310834 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:08.311790 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.312400 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.313593 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.313790 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.313847 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.316230 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:08.316232 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:08.316233 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:08.316241 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:08.317738 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.318169 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.318171 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.318172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.318234 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.318459 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.318460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.318460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.318586 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:08.318660 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.318944 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.319017 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:05:08.319224 32221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.309764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45925 (local address 127.29.82.67:54215)
0808 07:05:08.309946 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.309996 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.310654 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.310924 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.310929 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.311297 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:08.311685 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.311693 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.312485 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.312486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.313501 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.313504 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.313874 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.313876 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.313991 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.314500 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:08.314510 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:08.316133 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:08.317815 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:08.317821 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:08.317823 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:08.318100 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:08.318288 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:08.318289 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:08.318289 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:08.318399 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:08.318687 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:08.318693 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:08.318820 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.318902 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.319033 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
I20260808 07:05:08.319660 32379 heartbeater.cc:347] Connected to a master server at 127.29.82.126:45925
I20260808 07:05:08.319746 32379 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:08.319929 32379 heartbeater.cc:511] Master 127.29.82.126:45925 requested a full tablet report, sending...
I20260808 07:05:08.320329 31666 ts_manager.cc:194] Registered new tserver with Master: 3462e89a0c094a3fb3c4684116c4630c (127.29.82.67:42841)
I20260808 07:05:08.320806 31666 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:54215
I20260808 07:05:08.323206 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 32182
I20260808 07:05:08.323297 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:08.323537 30025 external_mini_cluster.cc:1428] Setting key e321e9f537d2c58675803f78a087e7fd
I20260808 07:05:08.324388 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:05:08.326222 31732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.320702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:33183 (local address 127.29.82.126:45925)
0808 07:05:08.320741 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.320742 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.320857 (+ 115us) server_negotiation.cc:407] Connection header received
0808 07:05:08.320922 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.320923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.320934 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.320960 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:08.321406 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.321901 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.322711 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.322897 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.322950 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.323861 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:08.323863 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:08.323863 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:08.323870 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:08.325219 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.325601 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.325601 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.325602 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.325653 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.325823 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.325824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.325824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.325922 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:08.325966 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.326099 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.326161 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:05:08.326282 32388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.320651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45925 (local address 127.29.82.67:33183)
0808 07:05:08.320798 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.320807 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.320861 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.321009 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.321010 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.321243 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:08.321319 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.321321 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.322034 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.322035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.322641 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.322643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.322966 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.322967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.323034 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.323442 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:08.323448 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:08.323781 (+ 333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:08.325310 (+ 1529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:08.325311 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:08.325312 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:08.325536 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:08.325710 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:08.325711 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:08.325711 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:08.325773 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:08.325970 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:08.325971 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:08.326017 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.326080 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.326181 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":67,"threads_started":1}
Aug 08 07:05:08 dist-test-slave-rmhg krb5kdc[31609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172708, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:05:08 dist-test-slave-rmhg krb5kdc[31609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172708, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:08.347694 31732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.341256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42076 (local address 127.29.82.126:45925)
0808 07:05:08.341312 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.341314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.341323 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:05:08.341348 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.341349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.341357 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.341405 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:08.341956 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.342503 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.343241 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.343432 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.343495 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.345584 (+ 2089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:08.345586 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:08.345587 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:08.345594 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:08.346834 (+ 1240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.347142 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.347142 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.347143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.347190 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.347319 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.347319 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.347320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.347419 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:08.347490 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.347563 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.347623 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:05:08.349272 31666 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:08.350806 31666 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:08.357419 32407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.353308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44194 (local address 127.29.82.65:37953)
0808 07:05:08.353523 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.353530 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.353542 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:05:08.353583 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.353585 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.353603 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.353706 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:08.353891 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.355102 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.356409 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.356976 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.357041 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.357105 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.357269 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.357313 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":72,"threads_started":1}
I20260808 07:05:08.357404 32404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.353053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:45297 (local address 127.0.0.1:41628)
0808 07:05:08.353347 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.353355 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.353393 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.353808 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.353809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.353811 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:08.353850 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.353851 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.355241 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.355242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.356201 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.356204 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.357143 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.357144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.357229 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.357233 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.357263 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.357325 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":20,"thread_start_us":84,"threads_started":1}
I20260808 07:05:08.357595 32402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.353057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:37953 (local address 127.0.0.1:44194)
0808 07:05:08.353482 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.353489 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.353523 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.353719 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.353722 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.353724 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:08.353802 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.353803 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.355211 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.355212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.356344 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.356346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.357061 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.357062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.357140 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.357177 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.357251 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.357529 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"mutex_wait_us":2,"thread_start_us":367,"threads_started":1}
I20260808 07:05:08.357585 32406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.353280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48424 (local address 127.29.82.67:42841)
0808 07:05:08.353661 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.353665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.353674 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:05:08.353826 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.353829 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.353844 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.353914 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:08.354039 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.354820 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.356319 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.357040 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.357122 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.357225 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.357443 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.357482 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":88,"threads_started":1}
I20260808 07:05:08.357661 32408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.353475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41628 (local address 127.29.82.66:45297)
0808 07:05:08.353644 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.353648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.353656 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:08.353690 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.353692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.353708 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.354027 (+ 319us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:08.354084 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.355174 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.356273 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.357040 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.357307 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.357369 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.357392 (+ 23us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.357431 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":79,"threads_started":1}
I20260808 07:05:08.357734 32405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.353053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:42841 (local address 127.0.0.1:48424)
0808 07:05:08.353285 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.353322 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.353393 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.353913 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.353914 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.353917 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:08.353966 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.353967 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.354894 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.354895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.356252 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.356254 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.357256 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.357257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.357311 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.357315 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.357358 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.357403 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":90,"threads_started":1}
I20260808 07:05:08.358402 32278 tablet_service.cc:1467] Processing CreateTablet for tablet 5993f0a097674ae78f69e4b17d434b58 (DEFAULT_TABLE table=test-table [id=e6a955214a334f5bb222152f94808e04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:08.358402 32066 tablet_service.cc:1467] Processing CreateTablet for tablet 5993f0a097674ae78f69e4b17d434b58 (DEFAULT_TABLE table=test-table [id=e6a955214a334f5bb222152f94808e04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:08.358784 32278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5993f0a097674ae78f69e4b17d434b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:08.358784 32066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5993f0a097674ae78f69e4b17d434b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:08.358706 31860 tablet_service.cc:1467] Processing CreateTablet for tablet 5993f0a097674ae78f69e4b17d434b58 (DEFAULT_TABLE table=test-table [id=e6a955214a334f5bb222152f94808e04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:08.359011 31860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5993f0a097674ae78f69e4b17d434b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:08.361914 32409 tablet_bootstrap.cc:492] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4: Bootstrap starting.
I20260808 07:05:08.362543 32409 tablet_bootstrap.cc:654] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:08.362540 32413 tablet_bootstrap.cc:492] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e: Bootstrap starting.
I20260808 07:05:08.362701 32410 tablet_bootstrap.cc:492] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c: Bootstrap starting.
I20260808 07:05:08.362890 32409 log.cc:824] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:08.363153 32413 tablet_bootstrap.cc:654] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:08.363395 32413 log.cc:824] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:08.363627 32410 tablet_bootstrap.cc:654] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:08.363776 32409 tablet_bootstrap.cc:492] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4: No bootstrap required, opened a new log
I20260808 07:05:08.363868 32409 ts_tablet_manager.cc:1397] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:08.363940 32410 log.cc:824] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:08.364156 32413 tablet_bootstrap.cc:492] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e: No bootstrap required, opened a new log
I20260808 07:05:08.364225 32413 ts_tablet_manager.cc:1397] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:08.364591 32410 tablet_bootstrap.cc:492] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c: No bootstrap required, opened a new log
I20260808 07:05:08.364657 32410 ts_tablet_manager.cc:1397] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:05:08.365866 32409 raft_consensus.cc:348] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } }
I20260808 07:05:08.366042 32409 raft_consensus.cc:374] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:08.366081 32409 raft_consensus.cc:729] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0e3ce51dae4881a03da5299c059eb4, State: Initialized, Role: FOLLOWER
I20260808 07:05:08.366096 32413 raft_consensus.cc:348] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } }
I20260808 07:05:08.366235 32413 raft_consensus.cc:374] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:08.366267 32413 raft_consensus.cc:729] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b21d184dc04fad8412c9165ceb278e, State: Initialized, Role: FOLLOWER
I20260808 07:05:08.366233 32409 consensus_queue.cc:260] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } }
I20260808 07:05:08.366191 32410 raft_consensus.cc:348] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } }
I20260808 07:05:08.366339 32410 raft_consensus.cc:374] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:08.366371 32410 raft_consensus.cc:729] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3462e89a0c094a3fb3c4684116c4630c, State: Initialized, Role: FOLLOWER
I20260808 07:05:08.366369 32413 consensus_queue.cc:260] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } }
I20260808 07:05:08.366544 32409 ts_tablet_manager.cc:1428] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:05:08.366513 32410 consensus_queue.cc:260] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } }
I20260808 07:05:08.366601 32413 ts_tablet_manager.cc:1428] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:05:08.366669 31957 heartbeater.cc:503] Master 127.29.82.126:45925 was elected leader, sending a full tablet report...
I20260808 07:05:08.366719 32167 heartbeater.cc:503] Master 127.29.82.126:45925 was elected leader, sending a full tablet report...
I20260808 07:05:08.366780 32410 ts_tablet_manager.cc:1428] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:05:08.366875 32379 heartbeater.cc:503] Master 127.29.82.126:45925 was elected leader, sending a full tablet report...
I20260808 07:05:08.368971 32420 raft_consensus.cc:482] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:08.369051 32420 raft_consensus.cc:504] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } }
I20260808 07:05:08.369338 32420 leader_election.cc:288] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3462e89a0c094a3fb3c4684116c4630c (127.29.82.67:42841), 7e0e3ce51dae4881a03da5299c059eb4 (127.29.82.65:37953)
I20260808 07:05:08.371973 32407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.369536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:47141 (local address 127.29.82.65:37953)
0808 07:05:08.369583 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.369585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.369597 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:05:08.369634 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.369635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.369645 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.369701 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:08.369824 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.370348 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.371291 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.371657 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.371711 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.371720 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.371878 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.371910 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:05:08.371984 32406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.369585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:35781 (local address 127.29.82.67:42841)
0808 07:05:08.369622 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.369623 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.369700 (+ 77us) server_negotiation.cc:407] Connection header received
0808 07:05:08.369766 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.369767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.369776 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.369824 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:08.369978 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.370424 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.371297 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.371677 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.371744 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.371752 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.371880 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.371913 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:05:08.372000 32005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.369484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:37953 (local address 127.29.82.66:47141)
0808 07:05:08.369531 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.369541 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.369578 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.369707 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.369708 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.369710 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:08.369771 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.369772 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.370440 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.370442 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.371211 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.371213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.371730 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.371731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.371816 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.371820 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.371866 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.371907 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":18}
I20260808 07:05:08.372012 32423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.369511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:42841 (local address 127.29.82.66:35781)
0808 07:05:08.369640 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.369649 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.369701 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.369825 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.369826 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.369827 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:08.369887 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.369889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.370508 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.370508 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.371221 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.371222 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.371753 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.371754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.371820 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.371823 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.371869 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.371909 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":74,"threads_started":1}
I20260808 07:05:08.372298 31891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5993f0a097674ae78f69e4b17d434b58" candidate_uuid: "36b21d184dc04fad8412c9165ceb278e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0e3ce51dae4881a03da5299c059eb4" is_pre_election: true
I20260808 07:05:08.372385 32312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5993f0a097674ae78f69e4b17d434b58" candidate_uuid: "36b21d184dc04fad8412c9165ceb278e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3462e89a0c094a3fb3c4684116c4630c" is_pre_election: true
I20260808 07:05:08.372427 31891 raft_consensus.cc:2454] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b21d184dc04fad8412c9165ceb278e in term 0.
I20260808 07:05:08.372488 32312 raft_consensus.cc:2454] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b21d184dc04fad8412c9165ceb278e in term 0.
I20260808 07:05:08.372686 31997 leader_election.cc:302] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3462e89a0c094a3fb3c4684116c4630c, 36b21d184dc04fad8412c9165ceb278e; no voters:
I20260808 07:05:08.372818 32420 raft_consensus.cc:2781] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:08.372864 32420 raft_consensus.cc:482] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:08.372884 32420 raft_consensus.cc:3037] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:08.373549 32420 raft_consensus.cc:504] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } }
I20260808 07:05:08.373721 32420 leader_election.cc:288] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [CANDIDATE]: Term 1 election: Requested vote from peers 3462e89a0c094a3fb3c4684116c4630c (127.29.82.67:42841), 7e0e3ce51dae4881a03da5299c059eb4 (127.29.82.65:37953)
I20260808 07:05:08.373787 32312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5993f0a097674ae78f69e4b17d434b58" candidate_uuid: "36b21d184dc04fad8412c9165ceb278e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3462e89a0c094a3fb3c4684116c4630c"
I20260808 07:05:08.373852 32312 raft_consensus.cc:3037] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:08.374413 32312 raft_consensus.cc:2454] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b21d184dc04fad8412c9165ceb278e in term 1.
I20260808 07:05:08.374522 31891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5993f0a097674ae78f69e4b17d434b58" candidate_uuid: "36b21d184dc04fad8412c9165ceb278e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0e3ce51dae4881a03da5299c059eb4"
I20260808 07:05:08.374570 31997 leader_election.cc:302] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3462e89a0c094a3fb3c4684116c4630c, 36b21d184dc04fad8412c9165ceb278e; no voters:
I20260808 07:05:08.374593 31891 raft_consensus.cc:3037] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:08.374675 32420 raft_consensus.cc:2781] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:08.374820 32420 raft_consensus.cc:686] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [term 1 LEADER]: Becoming Leader. State: Replica: 36b21d184dc04fad8412c9165ceb278e, State: Running, Role: LEADER
I20260808 07:05:08.374910 32420 consensus_queue.cc:237] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } }
I20260808 07:05:08.375380 31891 raft_consensus.cc:2454] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b21d184dc04fad8412c9165ceb278e in term 1.
I20260808 07:05:08.375735 31667 catalog_manager.cc:5495] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b21d184dc04fad8412c9165ceb278e (127.29.82.66). New cstate: current_term: 1 leader_uuid: "36b21d184dc04fad8412c9165ceb278e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } health_report { overall_health: HEALTHY } } }
I20260808 07:05:08.383765 32408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.380691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41632 (local address 127.29.82.66:45297)
0808 07:05:08.380746 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.380747 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.381357 (+ 610us) server_negotiation.cc:407] Connection header received
0808 07:05:08.381448 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.381449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.381469 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.381536 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:08.381730 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.382178 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.382893 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.383082 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.383134 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.383343 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:08.383427 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:08.383485 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.383525 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.383543 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:05:08.385459 31891 raft_consensus.cc:1261] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4 [term 1 FOLLOWER]: Refusing update from remote peer 36b21d184dc04fad8412c9165ceb278e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:08.385507 32312 raft_consensus.cc:1261] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c [term 1 FOLLOWER]: Refusing update from remote peer 36b21d184dc04fad8412c9165ceb278e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:08.385818 32426 consensus_queue.cc:1035] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:08.385948 32420 consensus_queue.cc:1035] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:08.387982 32429 mvcc.cc:205] Tried to move back new op lower bound from 7316163413544247296 to 7316163413504266240. Current Snapshot: MvccSnapshot[applied={T|T < 7316163413544247296}]
I20260808 07:05:08.388355 32431 mvcc.cc:205] Tried to move back new op lower bound from 7316163413544247296 to 7316163413504266240. Current Snapshot: MvccSnapshot[applied={T|T < 7316163413544247296}]
I20260808 07:05:08.391680 31665 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:08.391764 31665 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:08.392490 31665 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700: Sending DeleteTablet for 3 replicas of tablet 5993f0a097674ae78f69e4b17d434b58
I20260808 07:05:08.392822 32066 tablet_service.cc:1514] Processing DeleteTablet for tablet 5993f0a097674ae78f69e4b17d434b58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:08 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:41628
I20260808 07:05:08.392824 32278 tablet_service.cc:1514] Processing DeleteTablet for tablet 5993f0a097674ae78f69e4b17d434b58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:08 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:48424
I20260808 07:05:08.392846 31860 tablet_service.cc:1514] Processing DeleteTablet for tablet 5993f0a097674ae78f69e4b17d434b58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:08 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:44194
I20260808 07:05:08.393072 31665 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:08.393249 31665 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:08.393342 32441 tablet_replica.cc:330] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4: stopping tablet replica
I20260808 07:05:08.393435 32442 tablet_replica.cc:330] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c: stopping tablet replica
I20260808 07:05:08.393442 32440 tablet_replica.cc:330] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e: stopping tablet replica
I20260808 07:05:08.393571 32440 raft_consensus.cc:2229] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:05:08.393677 32440 raft_consensus.cc:2258] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:08.393828 32442 raft_consensus.cc:2229] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:08.393965 32442 raft_consensus.cc:2258] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:08.394420 32440 ts_tablet_manager.cc:1905] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:08.394737 31860 tablet_service.cc:1467] Processing CreateTablet for tablet a98c473222c4480f828f952d3b085487 (DEFAULT_TABLE table=test-table [id=ab46881cd0c04f42b36aaef1d6caf639]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:08.394853 31860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a98c473222c4480f828f952d3b085487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:08.395876 32066 tablet_service.cc:1467] Processing CreateTablet for tablet a98c473222c4480f828f952d3b085487 (DEFAULT_TABLE table=test-table [id=ab46881cd0c04f42b36aaef1d6caf639]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:08.396090 32409 tablet_bootstrap.cc:492] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4: Bootstrap starting.
I20260808 07:05:08.396353 32440 ts_tablet_manager.cc:1918] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:08.396427 32440 log.cc:1196] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/5993f0a097674ae78f69e4b17d434b58
I20260808 07:05:08.396500 32409 tablet_bootstrap.cc:654] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:08.396703 32440 ts_tablet_manager.cc:1939] T 5993f0a097674ae78f69e4b17d434b58 P 36b21d184dc04fad8412c9165ceb278e: Deleting consensus metadata
I20260808 07:05:08.396957 32278 tablet_service.cc:1467] Processing CreateTablet for tablet a98c473222c4480f828f952d3b085487 (DEFAULT_TABLE table=test-table [id=ab46881cd0c04f42b36aaef1d6caf639]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:08.397042 32066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a98c473222c4480f828f952d3b085487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:08.397065 32278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a98c473222c4480f828f952d3b085487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:08.397116 31651 catalog_manager.cc:4841] TS 36b21d184dc04fad8412c9165ceb278e (127.29.82.66:45297): tablet 5993f0a097674ae78f69e4b17d434b58 (table test-table [id=e6a955214a334f5bb222152f94808e04]) successfully deleted
I20260808 07:05:08.398218 32413 tablet_bootstrap.cc:492] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e: Bootstrap starting.
I20260808 07:05:08.398224 32441 raft_consensus.cc:2229] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:08.398350 32441 raft_consensus.cc:2258] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:08.398629 32413 tablet_bootstrap.cc:654] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:08.398693 32410 tablet_bootstrap.cc:492] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c: Bootstrap starting.
I20260808 07:05:08.398886 32409 tablet_bootstrap.cc:492] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4: No bootstrap required, opened a new log
I20260808 07:05:08.398936 32409 ts_tablet_manager.cc:1397] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:05:08.398955 32442 ts_tablet_manager.cc:1905] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:08.399091 32410 tablet_bootstrap.cc:654] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:08.399080 32409 raft_consensus.cc:348] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.399163 32409 raft_consensus.cc:374] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:08.399184 32409 raft_consensus.cc:729] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0e3ce51dae4881a03da5299c059eb4, State: Initialized, Role: FOLLOWER
I20260808 07:05:08.399230 32409 consensus_queue.cc:260] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.399322 32409 ts_tablet_manager.cc:1428] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:08.399842 32441 ts_tablet_manager.cc:1905] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:08.400327 32442 ts_tablet_manager.cc:1918] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:08.400401 32442 log.cc:1196] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/5993f0a097674ae78f69e4b17d434b58
I20260808 07:05:08.400637 32442 ts_tablet_manager.cc:1939] T 5993f0a097674ae78f69e4b17d434b58 P 3462e89a0c094a3fb3c4684116c4630c: Deleting consensus metadata
I20260808 07:05:08.400998 31649 catalog_manager.cc:4841] TS 3462e89a0c094a3fb3c4684116c4630c (127.29.82.67:42841): tablet 5993f0a097674ae78f69e4b17d434b58 (table test-table [id=e6a955214a334f5bb222152f94808e04]) successfully deleted
I20260808 07:05:08.401480 32413 tablet_bootstrap.cc:492] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e: No bootstrap required, opened a new log
I20260808 07:05:08.401525 32413 ts_tablet_manager.cc:1397] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:05:08.401582 32441 ts_tablet_manager.cc:1918] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:08.401664 32441 log.cc:1196] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/wal/wals/5993f0a097674ae78f69e4b17d434b58
I20260808 07:05:08.401652 32413 raft_consensus.cc:348] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.401728 32413 raft_consensus.cc:374] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:08.401753 32413 raft_consensus.cc:729] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b21d184dc04fad8412c9165ceb278e, State: Initialized, Role: FOLLOWER
I20260808 07:05:08.401791 32413 consensus_queue.cc:260] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.401875 32413 ts_tablet_manager.cc:1428] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:08.401916 32441 ts_tablet_manager.cc:1939] T 5993f0a097674ae78f69e4b17d434b58 P 7e0e3ce51dae4881a03da5299c059eb4: Deleting consensus metadata
I20260808 07:05:08.402261 31652 catalog_manager.cc:4841] TS 7e0e3ce51dae4881a03da5299c059eb4 (127.29.82.65:37953): tablet 5993f0a097674ae78f69e4b17d434b58 (table test-table [id=e6a955214a334f5bb222152f94808e04]) successfully deleted
I20260808 07:05:08.405509 32410 tablet_bootstrap.cc:492] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c: No bootstrap required, opened a new log
I20260808 07:05:08.405583 32410 ts_tablet_manager.cc:1397] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
W20260808 07:05:08.405666 32168 tablet.cc:2369] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:08.405718 32410 raft_consensus.cc:348] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.405784 32410 raft_consensus.cc:374] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:08.405812 32410 raft_consensus.cc:729] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3462e89a0c094a3fb3c4684116c4630c, State: Initialized, Role: FOLLOWER
I20260808 07:05:08.405855 32410 consensus_queue.cc:260] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.405941 32410 ts_tablet_manager.cc:1428] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:08.432004 32436 raft_consensus.cc:482] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:08.432129 32436 raft_consensus.cc:504] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.432583 32436 leader_election.cc:288] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0e3ce51dae4881a03da5299c059eb4 (127.29.82.65:37953), 3462e89a0c094a3fb3c4684116c4630c (127.29.82.67:42841)
I20260808 07:05:08.432768 32312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a98c473222c4480f828f952d3b085487" candidate_uuid: "36b21d184dc04fad8412c9165ceb278e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3462e89a0c094a3fb3c4684116c4630c" is_pre_election: true
I20260808 07:05:08.432785 31891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a98c473222c4480f828f952d3b085487" candidate_uuid: "36b21d184dc04fad8412c9165ceb278e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0e3ce51dae4881a03da5299c059eb4" is_pre_election: true
I20260808 07:05:08.432862 32312 raft_consensus.cc:2454] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b21d184dc04fad8412c9165ceb278e in term 0.
I20260808 07:05:08.432874 31891 raft_consensus.cc:2454] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b21d184dc04fad8412c9165ceb278e in term 0.
I20260808 07:05:08.433019 31997 leader_election.cc:302] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3462e89a0c094a3fb3c4684116c4630c, 36b21d184dc04fad8412c9165ceb278e; no voters:
I20260808 07:05:08.433168 32436 raft_consensus.cc:2781] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:08.433219 32436 raft_consensus.cc:482] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:08.433245 32436 raft_consensus.cc:3037] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:08.434144 32436 raft_consensus.cc:504] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.434284 32436 leader_election.cc:288] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [CANDIDATE]: Term 1 election: Requested vote from peers 7e0e3ce51dae4881a03da5299c059eb4 (127.29.82.65:37953), 3462e89a0c094a3fb3c4684116c4630c (127.29.82.67:42841)
I20260808 07:05:08.434455 32312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a98c473222c4480f828f952d3b085487" candidate_uuid: "36b21d184dc04fad8412c9165ceb278e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3462e89a0c094a3fb3c4684116c4630c"
I20260808 07:05:08.434532 32312 raft_consensus.cc:3037] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:08.435099 32312 raft_consensus.cc:2454] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b21d184dc04fad8412c9165ceb278e in term 1.
I20260808 07:05:08.435210 31891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a98c473222c4480f828f952d3b085487" candidate_uuid: "36b21d184dc04fad8412c9165ceb278e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0e3ce51dae4881a03da5299c059eb4"
I20260808 07:05:08.435284 31891 raft_consensus.cc:3037] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:08.435276 31997 leader_election.cc:302] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3462e89a0c094a3fb3c4684116c4630c, 36b21d184dc04fad8412c9165ceb278e; no voters:
I20260808 07:05:08.435370 32436 raft_consensus.cc:2781] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:08.435436 32436 raft_consensus.cc:686] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [term 1 LEADER]: Becoming Leader. State: Replica: 36b21d184dc04fad8412c9165ceb278e, State: Running, Role: LEADER
I20260808 07:05:08.435505 32436 consensus_queue.cc:237] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.436082 31891 raft_consensus.cc:2454] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b21d184dc04fad8412c9165ceb278e in term 1.
I20260808 07:05:08.436379 31665 catalog_manager.cc:5495] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b21d184dc04fad8412c9165ceb278e (127.29.82.66). New cstate: current_term: 1 leader_uuid: "36b21d184dc04fad8412c9165ceb278e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } health_report { overall_health: UNKNOWN } } }
Aug 08 07:05:08 dist-test-slave-rmhg krb5kdc[31609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172707, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:08.473533 31732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.466044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42090 (local address 127.29.82.126:45925)
0808 07:05:08.466099 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.466101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.466198 (+ 97us) server_negotiation.cc:407] Connection header received
0808 07:05:08.466286 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.466287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.466296 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.466335 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:08.466969 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.467464 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.468530 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.468721 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.468787 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.471236 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:08.471238 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:08.471238 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:08.471245 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:08.472473 (+ 1228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.472797 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.472798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.472798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.472847 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.473012 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.473013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.473013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.473116 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:08.473196 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.473334 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.473415 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:05:08.473601 32456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.465937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45925 (local address 127.0.0.1:42090)
0808 07:05:08.466111 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.466124 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.466214 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.466369 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.466371 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.466818 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:08.466885 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.466888 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.467560 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.467561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.468432 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.468435 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.468812 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.468813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.468880 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.469544 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:08.469549 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:08.471148 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:08.472545 (+ 1397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:08.472553 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:08.472555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:08.472736 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:08.472898 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:08.472898 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:08.472898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:08.472964 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:08.473186 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:08.473195 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:08.473246 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.473307 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.473482 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":71,"thread_start_us":83,"threads_started":1}
I20260808 07:05:08.475703 31665 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:42090:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 07:05:08.475898 31665 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:08.477433 32278 tablet_service.cc:1467] Processing CreateTablet for tablet 9870a1ddde7147d69e2f805f7bcdcb74 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1442869005264ddf880dc4ba83b43fdf]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:05:08.477433 31860 tablet_service.cc:1467] Processing CreateTablet for tablet 9870a1ddde7147d69e2f805f7bcdcb74 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1442869005264ddf880dc4ba83b43fdf]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:05:08.477609 31860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9870a1ddde7147d69e2f805f7bcdcb74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:08.477609 32278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9870a1ddde7147d69e2f805f7bcdcb74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:08.479151 32409 tablet_bootstrap.cc:492] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4: Bootstrap starting.
I20260808 07:05:08.479223 32066 tablet_service.cc:1467] Processing CreateTablet for tablet 9870a1ddde7147d69e2f805f7bcdcb74 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1442869005264ddf880dc4ba83b43fdf]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:05:08.479357 32066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9870a1ddde7147d69e2f805f7bcdcb74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:08.479647 32409 tablet_bootstrap.cc:654] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:08.480000 32410 tablet_bootstrap.cc:492] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c: Bootstrap starting.
I20260808 07:05:08.480293 32409 tablet_bootstrap.cc:492] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4: No bootstrap required, opened a new log
I20260808 07:05:08.480340 32409 ts_tablet_manager.cc:1397] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:08.480445 32410 tablet_bootstrap.cc:654] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:08.480500 32409 raft_consensus.cc:348] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.480567 32409 raft_consensus.cc:374] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:08.480587 32409 raft_consensus.cc:729] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0e3ce51dae4881a03da5299c059eb4, State: Initialized, Role: FOLLOWER
I20260808 07:05:08.480579 32413 tablet_bootstrap.cc:492] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e: Bootstrap starting.
I20260808 07:05:08.480628 32409 consensus_queue.cc:260] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.480717 32409 ts_tablet_manager.cc:1428] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:08.480870 32419 tablet_replica.cc:439] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } }
I20260808 07:05:08.480947 32419 tablet_replica.cc:442] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:05:08.481259 32413 tablet_bootstrap.cc:654] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:08.481969 32413 tablet_bootstrap.cc:492] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e: No bootstrap required, opened a new log
I20260808 07:05:08.481967 32410 tablet_bootstrap.cc:492] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c: No bootstrap required, opened a new log
I20260808 07:05:08.482023 32410 ts_tablet_manager.cc:1397] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:08.482023 32413 ts_tablet_manager.cc:1397] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.001s
I20260808 07:05:08.482167 32410 raft_consensus.cc:348] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.482200 32413 raft_consensus.cc:348] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.482240 32410 raft_consensus.cc:374] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:08.482257 32413 raft_consensus.cc:374] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:08.482260 32410 raft_consensus.cc:729] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3462e89a0c094a3fb3c4684116c4630c, State: Initialized, Role: FOLLOWER
I20260808 07:05:08.482285 32413 raft_consensus.cc:729] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b21d184dc04fad8412c9165ceb278e, State: Initialized, Role: FOLLOWER
I20260808 07:05:08.482312 32410 consensus_queue.cc:260] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.482326 32413 consensus_queue.cc:260] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.482402 32413 ts_tablet_manager.cc:1428] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:08.482402 32410 ts_tablet_manager.cc:1428] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:08.482478 32421 tablet_replica.cc:439] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } }
I20260808 07:05:08.482576 32421 tablet_replica.cc:442] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:05:08.482687 32426 tablet_replica.cc:439] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } }
I20260808 07:05:08.482761 32426 tablet_replica.cc:442] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e: This TxnStatusTablet replica's current role is: FOLLOWER
W20260808 07:05:08.487064 31958 tablet.cc:2369] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:08.550096 32419 raft_consensus.cc:482] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:08.550199 32419 raft_consensus.cc:504] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.550504 32419 leader_election.cc:288] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b21d184dc04fad8412c9165ceb278e (127.29.82.66:45297), 3462e89a0c094a3fb3c4684116c4630c (127.29.82.67:42841)
I20260808 07:05:08.553366 32406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.550793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:45389 (local address 127.29.82.67:42841)
0808 07:05:08.550848 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.550850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.550946 (+ 96us) server_negotiation.cc:407] Connection header received
0808 07:05:08.551011 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.551012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.551021 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.551071 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:08.551206 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.551665 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.552606 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.553003 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.553057 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.553065 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.553255 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.553294 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:05:08.553429 32408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.550779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:51023 (local address 127.29.82.66:45297)
0808 07:05:08.550833 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.550835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.550916 (+ 81us) server_negotiation.cc:407] Connection header received
0808 07:05:08.550969 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.550969 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.550982 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.551034 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:08.551193 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.551671 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.552716 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.553077 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.553172 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.553182 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.553327 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.553370 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:05:08.553376 32464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.550715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:42841 (local address 127.29.82.65:45389)
0808 07:05:08.550866 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.550876 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.550951 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.551074 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.551075 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.551077 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:08.551149 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.551151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.551740 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.551742 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.552529 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.552532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.553082 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.553083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.553184 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.553189 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.553234 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.553269 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":2,"thread_start_us":66,"threads_started":1}
I20260808 07:05:08.553534 32463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.550715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:45297 (local address 127.29.82.65:51023)
0808 07:05:08.550843 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.550854 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.550916 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.551043 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.551044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.551046 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:08.551131 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.551133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.551744 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.551745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.552633 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.552636 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.553178 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.553179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.553256 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.553262 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.553313 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.553355 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":39,"thread_start_us":65,"threads_started":1}
I20260808 07:05:08.553849 32312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9870a1ddde7147d69e2f805f7bcdcb74" candidate_uuid: "7e0e3ce51dae4881a03da5299c059eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3462e89a0c094a3fb3c4684116c4630c" is_pre_election: true
I20260808 07:05:08.553941 32312 raft_consensus.cc:2454] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0e3ce51dae4881a03da5299c059eb4 in term 0.
I20260808 07:05:08.553885 32100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9870a1ddde7147d69e2f805f7bcdcb74" candidate_uuid: "7e0e3ce51dae4881a03da5299c059eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b21d184dc04fad8412c9165ceb278e" is_pre_election: true
I20260808 07:05:08.554015 32100 raft_consensus.cc:2454] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0e3ce51dae4881a03da5299c059eb4 in term 0.
I20260808 07:05:08.554107 31801 leader_election.cc:302] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3462e89a0c094a3fb3c4684116c4630c, 7e0e3ce51dae4881a03da5299c059eb4; no voters:
I20260808 07:05:08.554258 32419 raft_consensus.cc:2781] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:08.554306 32419 raft_consensus.cc:482] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:08.554324 32419 raft_consensus.cc:3037] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:08.555241 32419 raft_consensus.cc:504] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.555373 32419 leader_election.cc:288] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [CANDIDATE]: Term 1 election: Requested vote from peers 36b21d184dc04fad8412c9165ceb278e (127.29.82.66:45297), 3462e89a0c094a3fb3c4684116c4630c (127.29.82.67:42841)
I20260808 07:05:08.555528 32100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9870a1ddde7147d69e2f805f7bcdcb74" candidate_uuid: "7e0e3ce51dae4881a03da5299c059eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b21d184dc04fad8412c9165ceb278e"
I20260808 07:05:08.555537 32312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9870a1ddde7147d69e2f805f7bcdcb74" candidate_uuid: "7e0e3ce51dae4881a03da5299c059eb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3462e89a0c094a3fb3c4684116c4630c"
I20260808 07:05:08.555608 32100 raft_consensus.cc:3037] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:08.555608 32312 raft_consensus.cc:3037] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:08.556344 32312 raft_consensus.cc:2454] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0e3ce51dae4881a03da5299c059eb4 in term 1.
I20260808 07:05:08.556416 32100 raft_consensus.cc:2454] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0e3ce51dae4881a03da5299c059eb4 in term 1.
I20260808 07:05:08.556533 31801 leader_election.cc:302] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3462e89a0c094a3fb3c4684116c4630c, 7e0e3ce51dae4881a03da5299c059eb4; no voters:
I20260808 07:05:08.556674 32419 raft_consensus.cc:2781] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:08.556790 32419 raft_consensus.cc:686] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [term 1 LEADER]: Becoming Leader. State: Replica: 7e0e3ce51dae4881a03da5299c059eb4, State: Running, Role: LEADER
I20260808 07:05:08.556876 32419 consensus_queue.cc:237] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } }
I20260808 07:05:08.557209 32465 tablet_replica.cc:439] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4: TxnStatusTablet state changed. Reason: New leader 7e0e3ce51dae4881a03da5299c059eb4. Latest consensus state: current_term: 1 leader_uuid: "7e0e3ce51dae4881a03da5299c059eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } }
I20260808 07:05:08.557297 32465 tablet_replica.cc:442] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:05:08.557502 32471 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 07:05:08.557597 32471 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 07:05:08.557578 31667 catalog_manager.cc:5495] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0e3ce51dae4881a03da5299c059eb4 (127.29.82.65). New cstate: current_term: 1 leader_uuid: "7e0e3ce51dae4881a03da5299c059eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } health_report { overall_health: UNKNOWN } } }
W20260808 07:05:08.568095 32380 tablet.cc:2369] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:08.578104 32456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.575609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:37953 (local address 127.0.0.1:44198)
0808 07:05:08.575689 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.575702 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.575742 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.575919 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.575920 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.575922 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:05:08.575984 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.575986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.576624 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.576625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.577247 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.577249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.577584 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.577585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.577650 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.577669 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:05:08.577928 (+ 259us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:05:08.577937 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.577977 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.578030 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 07:05:08.578097 32407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.575717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44198 (local address 127.29.82.65:37953)
0808 07:05:08.575784 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.575786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.575794 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:08.575828 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.575829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.575849 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.575906 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:08.576046 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.576543 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.577320 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.577521 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.577590 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.577760 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:08.577868 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:08.577933 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.577991 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.578016 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 07:05:08.579329 32312 raft_consensus.cc:1261] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c [term 1 FOLLOWER]: Refusing update from remote peer 7e0e3ce51dae4881a03da5299c059eb4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:08.579386 32100 raft_consensus.cc:1261] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e [term 1 FOLLOWER]: Refusing update from remote peer 7e0e3ce51dae4881a03da5299c059eb4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:08.579619 32465 consensus_queue.cc:1035] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:08.579751 32419 consensus_queue.cc:1035] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:08.580498 32426 tablet_replica.cc:439] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e: TxnStatusTablet state changed. Reason: New leader 7e0e3ce51dae4881a03da5299c059eb4. Latest consensus state: current_term: 1 leader_uuid: "7e0e3ce51dae4881a03da5299c059eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } }
I20260808 07:05:08.580587 32426 tablet_replica.cc:442] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:05:08.580660 32421 tablet_replica.cc:439] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c: TxnStatusTablet state changed. Reason: New leader 7e0e3ce51dae4881a03da5299c059eb4. Latest consensus state: current_term: 1 leader_uuid: "7e0e3ce51dae4881a03da5299c059eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } }
I20260808 07:05:08.580777 32421 tablet_replica.cc:442] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:05:08.581405 32465 tablet_replica.cc:439] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7e0e3ce51dae4881a03da5299c059eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } }
I20260808 07:05:08.581538 32430 mvcc.cc:205] Tried to move back new op lower bound from 7316163414338818048 to 7316163414249619456. Current Snapshot: MvccSnapshot[applied={T|T < 7316163414338818048}]
I20260808 07:05:08.581633 32421 tablet_replica.cc:439] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7e0e3ce51dae4881a03da5299c059eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } }
I20260808 07:05:08.581708 32421 tablet_replica.cc:442] T 9870a1ddde7147d69e2f805f7bcdcb74 P 3462e89a0c094a3fb3c4684116c4630c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:05:08.581817 32465 tablet_replica.cc:442] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:05:08.585952 32419 tablet_replica.cc:439] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7e0e3ce51dae4881a03da5299c059eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } }
I20260808 07:05:08.586036 32419 tablet_replica.cc:442] T 9870a1ddde7147d69e2f805f7bcdcb74 P 7e0e3ce51dae4881a03da5299c059eb4: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:05:08.586314 32426 tablet_replica.cc:439] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7e0e3ce51dae4881a03da5299c059eb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 } } peers { permanent_uuid: "36b21d184dc04fad8412c9165ceb278e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45297 } } peers { permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 } } }
I20260808 07:05:08.586395 32426 tablet_replica.cc:442] T 9870a1ddde7147d69e2f805f7bcdcb74 P 36b21d184dc04fad8412c9165ceb278e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:05:08.588013 32407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.585369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:33657 (local address 127.29.82.65:37953)
0808 07:05:08.585411 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.585413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.585421 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:08.585473 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.585474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.585484 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.585525 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:08.585687 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.586347 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.587319 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.587563 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.587625 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.587769 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:08.587825 (+ 56us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:08.587865 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.587923 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.587947 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:05:08.588028 32176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.585316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:37953 (local address 127.29.82.66:33657)
0808 07:05:08.585375 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.585386 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.585427 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.585564 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.585565 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.585567 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:05:08.585614 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.585616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.586524 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.586525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.587241 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.587243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.587630 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.587631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.587688 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.587702 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:05:08.587874 (+ 172us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:05:08.587876 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.587912 (+ 36us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.587964 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18,"mutex_wait_us":2}
I20260808 07:05:08.590363 31891 raft_consensus.cc:1261] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4 [term 1 FOLLOWER]: Refusing update from remote peer 36b21d184dc04fad8412c9165ceb278e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:08.590377 32312 raft_consensus.cc:1261] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c [term 1 FOLLOWER]: Refusing update from remote peer 36b21d184dc04fad8412c9165ceb278e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:08.590581 32426 consensus_queue.cc:1035] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3462e89a0c094a3fb3c4684116c4630c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:08.590721 32436 consensus_queue.cc:1035] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0e3ce51dae4881a03da5299c059eb4" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:08.599149 32408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.596421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:56235 (local address 127.29.82.66:45297)
0808 07:05:08.596459 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.596461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.596622 (+ 161us) server_negotiation.cc:407] Connection header received
0808 07:05:08.596675 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.596676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.596684 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.596726 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:08.596846 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.597353 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.598477 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.598671 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.598721 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.598927 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:08.598953 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:08.598982 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.599049 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.599085 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:05:08.599226 32491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.596365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:45297 (local address 127.29.82.65:56235)
0808 07:05:08.596544 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:08.596557 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:08.596621 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:08.596731 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:08.596731 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:08.596733 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:05:08.596795 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.596797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.597412 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.597413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.598401 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:08.598404 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.598758 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.598759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:08.598837 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.598855 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:05:08.598998 (+ 143us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:05:08.598999 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:05:08.599064 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 07:05:08.599108 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":84,"threads_started":1}
I20260808 07:05:08.611279 31665 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:08.611380 31665 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:08.612418 31665 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a51c56e34a3f4de4ae25339111756700: Sending DeleteTablet for 3 replicas of tablet a98c473222c4480f828f952d3b085487
I20260808 07:05:08.612668 32278 tablet_service.cc:1514] Processing DeleteTablet for tablet a98c473222c4480f828f952d3b085487 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:08 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:48424
I20260808 07:05:08.612716 31860 tablet_service.cc:1514] Processing DeleteTablet for tablet a98c473222c4480f828f952d3b085487 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:08 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:44194
I20260808 07:05:08.612780 32066 tablet_service.cc:1514] Processing DeleteTablet for tablet a98c473222c4480f828f952d3b085487 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:08 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:41628
I20260808 07:05:08.612815 32442 tablet_replica.cc:330] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c: stopping tablet replica
I20260808 07:05:08.612856 32440 tablet_replica.cc:330] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e: stopping tablet replica
I20260808 07:05:08.612872 32442 raft_consensus.cc:2229] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:08.612906 32440 raft_consensus.cc:2229] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:05:08.612913 32442 raft_consensus.cc:2258] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:08.612974 32440 raft_consensus.cc:2258] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:08.612985 32441 tablet_replica.cc:330] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4: stopping tablet replica
I20260808 07:05:08.613032 32441 raft_consensus.cc:2229] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:08.613070 32441 raft_consensus.cc:2258] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:08.613310 32440 ts_tablet_manager.cc:1905] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:08.613512 32442 ts_tablet_manager.cc:1905] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:08.614092 32441 ts_tablet_manager.cc:1905] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:08.614945 32440 ts_tablet_manager.cc:1918] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:05:08.614995 32440 log.cc:1196] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/a98c473222c4480f828f952d3b085487
I20260808 07:05:08.615043 32442 ts_tablet_manager.cc:1918] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:05:08.615094 32442 log.cc:1196] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/a98c473222c4480f828f952d3b085487
I20260808 07:05:08.615190 32440 ts_tablet_manager.cc:1939] T a98c473222c4480f828f952d3b085487 P 36b21d184dc04fad8412c9165ceb278e: Deleting consensus metadata
I20260808 07:05:08.615294 32442 ts_tablet_manager.cc:1939] T a98c473222c4480f828f952d3b085487 P 3462e89a0c094a3fb3c4684116c4630c: Deleting consensus metadata
I20260808 07:05:08.615564 32441 ts_tablet_manager.cc:1918] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:05:08.615617 32441 log.cc:1196] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172701750152-30025-0/minicluster-data/ts-0/wal/wals/a98c473222c4480f828f952d3b085487
I20260808 07:05:08.615695 31649 catalog_manager.cc:4841] TS 3462e89a0c094a3fb3c4684116c4630c (127.29.82.67:42841): tablet a98c473222c4480f828f952d3b085487 (table test-table [id=ab46881cd0c04f42b36aaef1d6caf639]) successfully deleted
I20260808 07:05:08.615772 31651 catalog_manager.cc:4841] TS 36b21d184dc04fad8412c9165ceb278e (127.29.82.66:45297): tablet a98c473222c4480f828f952d3b085487 (table test-table [id=ab46881cd0c04f42b36aaef1d6caf639]) successfully deleted
I20260808 07:05:08.615805 32441 ts_tablet_manager.cc:1939] T a98c473222c4480f828f952d3b085487 P 7e0e3ce51dae4881a03da5299c059eb4: Deleting consensus metadata
I20260808 07:05:08.616127 31652 catalog_manager.cc:4841] TS 7e0e3ce51dae4881a03da5299c059eb4 (127.29.82.65:37953): tablet a98c473222c4480f828f952d3b085487 (table test-table [id=ab46881cd0c04f42b36aaef1d6caf639]) successfully deleted
Aug 08 07:05:08 dist-test-slave-rmhg krb5kdc[31609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172708, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.82.65@KRBTEST.COM
I20260808 07:05:08.624871 32407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.616029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44210 (local address 127.29.82.65:37953)
0808 07:05:08.616072 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.616074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.616338 (+ 264us) server_negotiation.cc:407] Connection header received
0808 07:05:08.616367 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.616368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.616380 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.616442 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:08.616966 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.617749 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.618468 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.618769 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.618826 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.622018 (+ 3192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:08.622028 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:08.622028 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:08.622036 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:08.623788 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.624100 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.624105 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.624105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.624180 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.624333 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.624334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.624335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.624515 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:08.624654 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.624694 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.624777 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 07:05:08.625144 31949 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44210
I20260808 07:05:08.632110 31732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:08.626092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42094 (local address 127.29.82.126:45925)
0808 07:05:08.626142 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:08.626144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:08.626201 (+ 57us) server_negotiation.cc:407] Connection header received
0808 07:05:08.626249 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:08.626251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:08.626261 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:08.626318 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:08.626763 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.627554 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.628219 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:08.628515 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:08.628596 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:08.629723 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:08.629726 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:08.629726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:08.629734 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:08.631154 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.631441 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.631442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.631443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.631504 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:08.631648 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:08.631648 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:08.631649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:08.631771 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:08.631867 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:08.631926 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 07:05:08.632011 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 07:05:08.632360 31665 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42094
I20260808 07:05:08.633093 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 31769
I20260808 07:05:08.643661 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 31967
I20260808 07:05:08.652743 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 32182
I20260808 07:05:08.658537 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 31629
2026-08-08T07:05:08Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2264 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:08 dist-test-slave-rmhg krb5kdc[32501](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:08 dist-test-slave-rmhg krb5kdc[32501](info): set up 2 sockets
Aug 08 07:05:08 dist-test-slave-rmhg krb5kdc[32501](info): commencing operation
krb5kdc: starting...
W20260808 07:05:09.785552 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:05:09 dist-test-slave-rmhg krb5kdc[32501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172709, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:05:09.912184 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:44653
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:38431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:44653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:09.995803 32520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:09.996029 32520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:09.996052 32520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:09.997272 32520 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:09.997318 32520 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 07:05:09.997329 32520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:09.997341 32520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:09.997351 32520 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:09.997362 32520 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:09.998952 32520 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:38431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:44653
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:44653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:09.999174 32520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:09.999364 32520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:10.004290 32528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:10.004259 32525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:10.004267 32526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:10.004650 32520 server_base.cc:1034] running on GCE node
I20260808 07:05:10.004875 32520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:10.005190 32520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:10.006361 32520 hybrid_clock.cc:648] HybridClock initialized: now 1786172710006341 us; error 38 us; skew 500 ppm
Aug 08 07:05:10 dist-test-slave-rmhg krb5kdc[32501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172710, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:10.009176 32520 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:05:10.009685 32520 webserver.cc:460] Webserver started at http://127.29.82.126:43437/ using document root <none> and password file <none>
I20260808 07:05:10.009912 32520 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:10.009959 32520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:10.010075 32520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:10.011282 32520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "75ddc55df9b446619149e0a5b5d9b703"
format_stamp: "Formatted at 2026-08-08 07:05:10 on dist-test-slave-rmhg"
server_key: "514ddc4be39a4f1299614231f484cb1f"
server_key_iv: "c18ef74e98056920ea8f74bf0b91886f"
server_key_version: "encryptionkey@0"
I20260808 07:05:10.011629 32520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "75ddc55df9b446619149e0a5b5d9b703"
format_stamp: "Formatted at 2026-08-08 07:05:10 on dist-test-slave-rmhg"
server_key: "514ddc4be39a4f1299614231f484cb1f"
server_key_iv: "c18ef74e98056920ea8f74bf0b91886f"
server_key_version: "encryptionkey@0"
I20260808 07:05:10.012979 32520 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:10.013763 32538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:10.013897 32520 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:10.013983 32520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "75ddc55df9b446619149e0a5b5d9b703"
format_stamp: "Formatted at 2026-08-08 07:05:10 on dist-test-slave-rmhg"
server_key: "514ddc4be39a4f1299614231f484cb1f"
server_key_iv: "c18ef74e98056920ea8f74bf0b91886f"
server_key_version: "encryptionkey@0"
I20260808 07:05:10.014053 32520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:10.033401 32520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:10.035683 32520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:10.035821 32520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:10.040633 32520 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:44653
I20260808 07:05:10.040699 32634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:44653 every 8 connection(s)
I20260808 07:05:10.041031 32520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:10.041759 32635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:10.044097 32635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703: Bootstrap starting.
I20260808 07:05:10.044708 32635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:10.044970 32635 log.cc:824] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:10.045707 32635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703: No bootstrap required, opened a new log
I20260808 07:05:10.047855 32635 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75ddc55df9b446619149e0a5b5d9b703" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44653 } }
I20260808 07:05:10.048030 32635 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:10.048067 32635 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ddc55df9b446619149e0a5b5d9b703, State: Initialized, Role: FOLLOWER
I20260808 07:05:10.048110 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 32520
I20260808 07:05:10.048199 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:10.048207 32635 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75ddc55df9b446619149e0a5b5d9b703" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44653 } }
I20260808 07:05:10.048295 32635 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:10.048336 32635 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:10.048363 30025 external_mini_cluster.cc:1428] Setting key 7b67f661c9b06538b34b681bdeaee135
I20260808 07:05:10.048378 32635 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:10.048944 32635 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75ddc55df9b446619149e0a5b5d9b703" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44653 } }
I20260808 07:05:10.049064 32635 leader_election.cc:302] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75ddc55df9b446619149e0a5b5d9b703; no voters:
I20260808 07:05:10.049252 32635 leader_election.cc:288] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:10.049295 32641 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:10.049407 32641 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [term 1 LEADER]: Becoming Leader. State: Replica: 75ddc55df9b446619149e0a5b5d9b703, State: Running, Role: LEADER
I20260808 07:05:10.049490 32641 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75ddc55df9b446619149e0a5b5d9b703" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44653 } }
I20260808 07:05:10.049530 32635 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:10.051198 32642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75ddc55df9b446619149e0a5b5d9b703" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75ddc55df9b446619149e0a5b5d9b703" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44653 } } }
I20260808 07:05:10.051299 32642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:10.051501 32643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75ddc55df9b446619149e0a5b5d9b703. Latest consensus state: current_term: 1 leader_uuid: "75ddc55df9b446619149e0a5b5d9b703" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75ddc55df9b446619149e0a5b5d9b703" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44653 } } }
I20260808 07:05:10.051568 32643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:10.051743 32664 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:10.052275 32664 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:10.053995 32664 catalog_manager.cc:1347] Generated new cluster ID: 35871875c146437b8a796d574edea42c
I20260808 07:05:10.054046 32664 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:05:10 dist-test-slave-rmhg krb5kdc[32501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172709, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:10.060726 32639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.048857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41350 (local address 127.29.82.126:44653)
0808 07:05:10.049045 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.049056 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.049092 (+ 36us) server_negotiation.cc:407] Connection header received
0808 07:05:10.049237 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.049244 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.049292 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.049444 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:10.050284 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.051740 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.052799 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.053374 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.053487 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.056478 (+ 2991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:10.056483 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:10.056483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:10.056496 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:10.059055 (+ 2559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.059471 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.059474 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.059475 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.059592 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.059789 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.059790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.059790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.060086 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:10.060224 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.060357 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.060499 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260808 07:05:10.071784 32664 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:10.072484 32664 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:10.076745 32664 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703: Generated new TSK 0
I20260808 07:05:10.076982 32664 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:05:10.108024 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:44653
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:38431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:10.191393 32670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:10.191638 32670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:10.191665 32670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:10.192847 32670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:10.192893 32670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:10.192912 32670 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 07:05:10.192924 32670 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:05:10.192939 32670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:05:10.194475 32670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:38431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.82.126:44653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:10.194725 32670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:10.194955 32670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:10.200186 32679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:10.200116 32680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:10.200256 32670 server_base.cc:1034] running on GCE node
W20260808 07:05:10.200095 32687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:10.200496 32670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:10.200765 32670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:10.201915 32670 hybrid_clock.cc:648] HybridClock initialized: now 1786172710201898 us; error 36 us; skew 500 ppm
Aug 08 07:05:10 dist-test-slave-rmhg krb5kdc[32501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172710, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:10.204491 32670 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:05:10.204936 32670 webserver.cc:460] Webserver started at http://127.29.82.65:43047/ using document root <none> and password file <none>
I20260808 07:05:10.205142 32670 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:10.205225 32670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:10.205355 32670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:10.206395 32670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "21305fb26d5e4eaea9c89380a3659af7"
format_stamp: "Formatted at 2026-08-08 07:05:10 on dist-test-slave-rmhg"
server_key: "3b2d62e71a0c398cdf70083feda56721"
server_key_iv: "422f28b153e75e9bb83add0900192369"
server_key_version: "encryptionkey@0"
I20260808 07:05:10.206743 32670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "21305fb26d5e4eaea9c89380a3659af7"
format_stamp: "Formatted at 2026-08-08 07:05:10 on dist-test-slave-rmhg"
server_key: "3b2d62e71a0c398cdf70083feda56721"
server_key_iv: "422f28b153e75e9bb83add0900192369"
server_key_version: "encryptionkey@0"
I20260808 07:05:10.208015 32670 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:10.208686 32698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:10.208855 32670 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:10.208942 32670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "21305fb26d5e4eaea9c89380a3659af7"
format_stamp: "Formatted at 2026-08-08 07:05:10 on dist-test-slave-rmhg"
server_key: "3b2d62e71a0c398cdf70083feda56721"
server_key_iv: "422f28b153e75e9bb83add0900192369"
server_key_version: "encryptionkey@0"
I20260808 07:05:10.208997 32670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:10.229136 32670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:10.231218 32670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:10.231331 32670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:10.231818 32670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:10.231858 32670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:10.231882 32670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:10.231894 32670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:10.238356 32670 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:39321
I20260808 07:05:10.238432 392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:39321 every 8 connection(s)
Aug 08 07:05:10 dist-test-slave-rmhg krb5kdc[32501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172710, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:10.238766 32670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:05:10.241580 32639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.232386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:59823 (local address 127.29.82.126:44653)
0808 07:05:10.232438 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.232441 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.232700 (+ 259us) server_negotiation.cc:407] Connection header received
0808 07:05:10.233258 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.233260 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.233279 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.233353 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:10.234208 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.234988 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.236499 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.236740 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.236797 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.239136 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:10.239138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:10.239138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:10.239147 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:10.240262 (+ 1115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.240642 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.240643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.240644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.240702 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.240917 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.240918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.240919 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.241043 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:10.241101 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.241400 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.241488 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:05:10.241757 32709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.232404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:44653 (local address 127.29.82.65:59823)
0808 07:05:10.232578 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.232615 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.233120 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.233434 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.233438 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.233787 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:10.234105 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.234113 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.235108 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.235109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.236413 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.236417 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.236819 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.236820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.236964 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.237553 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:10.237563 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:10.239048 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:10.240338 (+ 1290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:10.240345 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:10.240348 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:10.240571 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:10.240755 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:10.240756 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:10.240756 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:10.240861 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:10.241099 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:10.241106 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:10.241275 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.241365 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.241533 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":95,"threads_started":1}
I20260808 07:05:10.242216 393 heartbeater.cc:347] Connected to a master server at 127.29.82.126:44653
I20260808 07:05:10.242307 393 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:10.242484 393 heartbeater.cc:511] Master 127.29.82.126:44653 requested a full tablet report, sending...
I20260808 07:05:10.242985 32562 ts_manager.cc:194] Registered new tserver with Master: 21305fb26d5e4eaea9c89380a3659af7 (127.29.82.65:39321)
I20260808 07:05:10.243682 32562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:59823
I20260808 07:05:10.244189 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 32670
I20260808 07:05:10.244285 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:10.244475 30025 external_mini_cluster.cc:1428] Setting key 110748cd302613a6f55a2215c78f4d0b
I20260808 07:05:10.248514 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.243215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:44653 (local address 127.29.82.65:52635)
0808 07:05:10.243374 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.243383 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.243438 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.243559 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.243560 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.243726 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:10.243782 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.243784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.244603 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.244605 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.245110 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.245111 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.245468 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.245469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.245557 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.245955 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:10.245958 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:10.246215 (+ 257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:10.247647 (+ 1432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:10.247648 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:10.247648 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:10.247817 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:10.248019 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:10.248019 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:10.248020 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:10.248068 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:10.248289 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:10.248289 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:10.248325 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.248369 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.248447 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":70,"threads_started":1}
I20260808 07:05:10.248545 32639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.243267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:52635 (local address 127.29.82.126:44653)
0808 07:05:10.243311 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.243312 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.243436 (+ 124us) server_negotiation.cc:407] Connection header received
0808 07:05:10.243495 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.243495 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.243506 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.243546 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:10.243841 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.244485 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.245207 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.245407 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.245463 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.246292 (+ 829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:10.246293 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:10.246294 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:10.246300 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:10.247556 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.247884 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.247885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.247885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.247944 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.248117 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.248118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.248118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.248235 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:10.248297 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.248392 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.248468 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:05:10.269939 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:44653
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:38431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:10.352825 411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:10.353044 411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:10.353071 411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:10.354277 411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:10.354326 411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:10.354347 411 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 07:05:10.354370 411 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:05:10.354399 411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:05:10.355896 411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:38431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.82.126:44653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:10.356130 411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:10.356357 411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:10.361388 419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:10.361413 423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:10.361408 417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:10.361619 411 server_base.cc:1034] running on GCE node
I20260808 07:05:10.361819 411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:10.362047 411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:10.363205 411 hybrid_clock.cc:648] HybridClock initialized: now 1786172710363187 us; error 31 us; skew 500 ppm
Aug 08 07:05:10 dist-test-slave-rmhg krb5kdc[32501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172710, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:10.365728 411 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:05:10.366179 411 webserver.cc:460] Webserver started at http://127.29.82.66:43521/ using document root <none> and password file <none>
I20260808 07:05:10.366390 411 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:10.366430 411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:10.366525 411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:10.367527 411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "072b97f76da746d8b20c9409b2bd5e7a"
format_stamp: "Formatted at 2026-08-08 07:05:10 on dist-test-slave-rmhg"
server_key: "01c580742a36690fb20b3319c546dc0b"
server_key_iv: "ebcc6676b6b718e49643974818e48bab"
server_key_version: "encryptionkey@0"
I20260808 07:05:10.367823 411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "072b97f76da746d8b20c9409b2bd5e7a"
format_stamp: "Formatted at 2026-08-08 07:05:10 on dist-test-slave-rmhg"
server_key: "01c580742a36690fb20b3319c546dc0b"
server_key_iv: "ebcc6676b6b718e49643974818e48bab"
server_key_version: "encryptionkey@0"
I20260808 07:05:10.369030 411 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:05:10.369767 435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:10.370021 411 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:05:10.370121 411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "072b97f76da746d8b20c9409b2bd5e7a"
format_stamp: "Formatted at 2026-08-08 07:05:10 on dist-test-slave-rmhg"
server_key: "01c580742a36690fb20b3319c546dc0b"
server_key_iv: "ebcc6676b6b718e49643974818e48bab"
server_key_version: "encryptionkey@0"
I20260808 07:05:10.370196 411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:10.378877 411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:10.381549 411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:10.381707 411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:10.382350 411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:10.382398 411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:10.382428 411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:10.382445 411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:10.389586 411 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:42007
Aug 08 07:05:10 dist-test-slave-rmhg krb5kdc[32501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172710, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:10.389771 611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:42007 every 8 connection(s)
I20260808 07:05:10.389984 411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:05:10.392468 32639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.383312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:56395 (local address 127.29.82.126:44653)
0808 07:05:10.383360 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.383362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.383923 (+ 561us) server_negotiation.cc:407] Connection header received
0808 07:05:10.384549 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.384551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.384566 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.384618 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:10.385469 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.386234 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.387264 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.387573 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.387639 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.390218 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:10.390220 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:10.390220 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:10.390229 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:10.391439 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.391781 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.391782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.391782 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.391831 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.392005 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.392005 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.392005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.392102 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:10.392146 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.392348 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.392404 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:05:10.392656 449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.383476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:44653 (local address 127.29.82.66:56395)
0808 07:05:10.383788 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.383832 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.384431 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.384693 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.384697 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.385026 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:10.385357 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.385363 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.386341 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.386342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.387174 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.387177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.387651 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.387652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.387822 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.388356 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:10.388367 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:10.390132 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:10.391506 (+ 1374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:10.391512 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:10.391514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:10.391725 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:10.391874 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:10.391874 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:10.391874 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:10.391962 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:10.392142 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:10.392145 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:10.392255 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.392333 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.392451 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":99,"threads_started":1}
I20260808 07:05:10.393107 613 heartbeater.cc:347] Connected to a master server at 127.29.82.126:44653
I20260808 07:05:10.393224 613 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:10.393381 613 heartbeater.cc:511] Master 127.29.82.126:44653 requested a full tablet report, sending...
I20260808 07:05:10.393733 32563 ts_manager.cc:194] Registered new tserver with Master: 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007)
I20260808 07:05:10.394121 32563 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:56395
I20260808 07:05:10.395190 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 411
I20260808 07:05:10.395282 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:10.395462 30025 external_mini_cluster.cc:1428] Setting key 2befaa5e001c432598211933ef6cf621
I20260808 07:05:10.399597 32639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.394125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:33999 (local address 127.29.82.126:44653)
0808 07:05:10.394165 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.394167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.394244 (+ 77us) server_negotiation.cc:407] Connection header received
0808 07:05:10.394330 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.394331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.394341 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.394405 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:10.394752 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.395338 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.396114 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.396427 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.396488 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.397391 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:10.397393 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:10.397393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:10.397401 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:10.398597 (+ 1196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.398950 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.398951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.398951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.398996 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.399164 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.399164 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.399164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.399290 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:10.399337 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.399471 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.399526 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:05:10.399888 624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.394067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:44653 (local address 127.29.82.66:33999)
0808 07:05:10.394181 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.394192 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.394270 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.394422 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.394423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.394623 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:10.394683 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.394684 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.395418 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.395419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.396058 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.396061 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.396515 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.396516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.396589 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.396979 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:10.396983 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:10.397317 (+ 334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:10.398674 (+ 1357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:10.398675 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:10.398676 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:10.398884 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:10.399048 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:10.399049 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:10.399049 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:10.399110 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:10.399340 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:10.399341 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:10.399386 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.399455 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.399549 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":66,"threads_started":1}
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:05:10.420435 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:44653
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:38431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:10.504041 627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:10.504272 627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:10.504300 627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:10.505474 627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:10.505520 627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:10.505540 627 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 07:05:10.505551 627 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:05:10.505566 627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:05:10.506976 627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:38431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.82.126:44653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:10.507170 627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:10.507357 627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:10.512288 638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:10.512300 639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:10.512291 643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:10.512542 627 server_base.cc:1034] running on GCE node
I20260808 07:05:10.512745 627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:10.512988 627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:10.514149 627 hybrid_clock.cc:648] HybridClock initialized: now 1786172710514124 us; error 38 us; skew 500 ppm
Aug 08 07:05:10 dist-test-slave-rmhg krb5kdc[32501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172710, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:10.516533 627 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:05:10.516995 627 webserver.cc:460] Webserver started at http://127.29.82.67:40965/ using document root <none> and password file <none>
I20260808 07:05:10.517246 627 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:10.517314 627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:10.517448 627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:10.518494 627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "e28ac3a013dd40ec9b807604646f811f"
format_stamp: "Formatted at 2026-08-08 07:05:10 on dist-test-slave-rmhg"
server_key: "d031e5728863d2ba48889bab0aa3f1d2"
server_key_iv: "74e615c11c8170ed19dd6a70e2aaf068"
server_key_version: "encryptionkey@0"
I20260808 07:05:10.518827 627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "e28ac3a013dd40ec9b807604646f811f"
format_stamp: "Formatted at 2026-08-08 07:05:10 on dist-test-slave-rmhg"
server_key: "d031e5728863d2ba48889bab0aa3f1d2"
server_key_iv: "74e615c11c8170ed19dd6a70e2aaf068"
server_key_version: "encryptionkey@0"
I20260808 07:05:10.520097 627 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:10.520809 652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:10.520965 627 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:10.521057 627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "e28ac3a013dd40ec9b807604646f811f"
format_stamp: "Formatted at 2026-08-08 07:05:10 on dist-test-slave-rmhg"
server_key: "d031e5728863d2ba48889bab0aa3f1d2"
server_key_iv: "74e615c11c8170ed19dd6a70e2aaf068"
server_key_version: "encryptionkey@0"
I20260808 07:05:10.521118 627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:10.543542 627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:10.545750 627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:10.545907 627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:10.546479 627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:10.546522 627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:10.546552 627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:10.546567 627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:05:10 dist-test-slave-rmhg krb5kdc[32501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172710, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:10.553577 627 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:40375
I20260808 07:05:10.553647 838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:40375 every 8 connection(s)
I20260808 07:05:10.554013 627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:05:10.555742 32639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.546853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:35619 (local address 127.29.82.126:44653)
0808 07:05:10.546923 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.546926 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.547119 (+ 193us) server_negotiation.cc:407] Connection header received
0808 07:05:10.547597 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.547598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.547611 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.547691 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:10.548457 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.549230 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.550376 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.550709 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.550788 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.553135 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:10.553137 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:10.553137 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:10.553166 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:10.554695 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.555030 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.555031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.555031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.555079 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.555237 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.555238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.555238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.555333 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:10.555384 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.555609 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.555676 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 07:05:10.555917 665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.546825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:44653 (local address 127.29.82.67:35619)
0808 07:05:10.546990 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.547032 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.547503 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.547750 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.547754 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.548052 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:10.548345 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.548352 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.549323 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.549325 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.550289 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.550292 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.550808 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.550810 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.550954 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.551537 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:10.551548 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:10.553041 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:10.554761 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:10.554765 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:10.554767 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:10.554972 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:10.555115 (+ 143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:10.555116 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:10.555116 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:10.555198 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:10.555381 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:10.555384 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:10.555495 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.555571 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.555698 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
I20260808 07:05:10.555910 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 627
I20260808 07:05:10.556017 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:10.556254 30025 external_mini_cluster.cc:1428] Setting key fa1bcf58a249f89062a2b1812089dbf8
I20260808 07:05:10.556407 840 heartbeater.cc:347] Connected to a master server at 127.29.82.126:44653
I20260808 07:05:10.556486 840 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:10.556675 840 heartbeater.cc:511] Master 127.29.82.126:44653 requested a full tablet report, sending...
I20260808 07:05:10.557030 32563 ts_manager.cc:194] Registered new tserver with Master: e28ac3a013dd40ec9b807604646f811f (127.29.82.67:40375)
I20260808 07:05:10.557487 32563 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:35619
I20260808 07:05:10.562517 32639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.557537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:45857 (local address 127.29.82.126:44653)
0808 07:05:10.557594 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.557596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.557719 (+ 123us) server_negotiation.cc:407] Connection header received
0808 07:05:10.557771 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.557772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.557782 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.557828 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:10.558130 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.558593 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.559268 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.559463 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.559517 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.560297 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:10.560298 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:10.560299 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:10.560305 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:10.561542 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.561846 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.561847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.561848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.561895 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.562059 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.562060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.562060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.562158 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:10.562212 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.562348 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.562419 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:05:10.562542 855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.557470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:44653 (local address 127.29.82.67:45857)
0808 07:05:10.557655 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.557664 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.557718 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.557842 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.557843 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.558012 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:10.558063 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.558064 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.558680 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.558681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.559197 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.559199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.559522 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.559523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.559610 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.559961 (+ 351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:10.559964 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:10.560219 (+ 255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:10.561623 (+ 1404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:10.561624 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:10.561625 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:10.561785 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:10.561948 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:10.561949 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:10.561949 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:10.562006 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:10.562211 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:10.562212 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:10.562260 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.562319 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.562421 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":71,"threads_started":1}
I20260808 07:05:10.567997 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:05:10 dist-test-slave-rmhg krb5kdc[32501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:05:10 dist-test-slave-rmhg krb5kdc[32501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:10.591353 32639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.585147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41360 (local address 127.29.82.126:44653)
0808 07:05:10.585241 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.585243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.585253 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:05:10.585285 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.585286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.585298 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.585363 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:10.585921 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.586406 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.587111 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.587290 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.587336 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.589451 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:10.589453 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:10.589454 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:10.589461 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:10.590529 (+ 1068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.590814 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.590815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.590816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.590865 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.590989 (+ 124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.590989 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.590989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.591086 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:10.591154 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.591226 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.591284 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:05:10.592964 32563 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:10.594655 32563 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:10.600981 869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.596930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:40375 (local address 127.0.0.1:32840)
0808 07:05:10.597092 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.597134 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.597219 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.597781 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.597782 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.597784 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:10.597834 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.597836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.599052 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.599053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.599939 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.599941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.600689 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.600690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.600769 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.600783 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.600849 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.600902 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":1,"thread_start_us":53,"threads_started":1}
I20260808 07:05:10.600994 872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.597109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32840 (local address 127.29.82.67:40375)
0808 07:05:10.597615 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.597620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.597630 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:05:10.597666 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.597668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.597683 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.597901 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:10.597957 (+ 56us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.598982 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.600096 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.600611 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.600673 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.600735 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.600869 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.600905 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":103,"threads_started":1}
I20260808 07:05:10.601279 873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.597140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:39321 (local address 127.0.0.1:34810)
0808 07:05:10.597367 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.597376 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.597419 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.597772 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.597773 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.597775 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:10.597830 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.597832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.598682 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.598683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.599979 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.599982 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.600987 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.600989 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.601068 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.601072 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.601121 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.601207 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":4,"thread_start_us":92,"threads_started":1}
I20260808 07:05:10.601560 875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.597364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34810 (local address 127.29.82.65:39321)
0808 07:05:10.597547 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.597551 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.597559 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:10.597612 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.597614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.597629 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.597704 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:10.597910 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.598604 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.600083 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.600830 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.600898 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.600950 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.601424 (+ 474us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.601464 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":80,"threads_started":1}
I20260808 07:05:10.601715 738 tablet_service.cc:1467] Processing CreateTablet for tablet 813ab033fcbf47a8800b6dc5ade7df20 (DEFAULT_TABLE table=test-table [id=9d53629e2174416686ddf9ce15c7dda6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:10.601873 871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.597066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38964 (local address 127.29.82.66:42007)
0808 07:05:10.597322 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.597327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.597337 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:05:10.597378 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.597380 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.597395 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.597469 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:10.597647 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.598792 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.600081 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.600830 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.600898 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.600950 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.601712 (+ 762us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.601757 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":105,"threads_started":1}
I20260808 07:05:10.602140 738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 813ab033fcbf47a8800b6dc5ade7df20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:10.602173 301 tablet_service.cc:1467] Processing CreateTablet for tablet 813ab033fcbf47a8800b6dc5ade7df20 (DEFAULT_TABLE table=test-table [id=9d53629e2174416686ddf9ce15c7dda6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:10.602453 301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 813ab033fcbf47a8800b6dc5ade7df20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:10.604619 876 tablet_bootstrap.cc:492] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f: Bootstrap starting.
I20260808 07:05:10.605113 868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.596939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:42007 (local address 127.0.0.1:38964)
0808 07:05:10.597257 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.597268 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.597323 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.597489 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.597492 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.597495 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:10.597561 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.597564 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.598872 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.598873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.599993 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.599994 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.600989 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.600990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.601560 (+ 570us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.601564 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.601627 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.601755 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":28,"thread_start_us":99,"threads_started":1}
I20260808 07:05:10.605329 877 tablet_bootstrap.cc:492] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7: Bootstrap starting.
I20260808 07:05:10.605777 876 tablet_bootstrap.cc:654] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:10.605844 877 tablet_bootstrap.cc:654] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:10.605821 515 tablet_service.cc:1467] Processing CreateTablet for tablet 813ab033fcbf47a8800b6dc5ade7df20 (DEFAULT_TABLE table=test-table [id=9d53629e2174416686ddf9ce15c7dda6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:10.606117 876 log.cc:824] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:10.606154 877 log.cc:824] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:10.606180 515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 813ab033fcbf47a8800b6dc5ade7df20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:10.606881 877 tablet_bootstrap.cc:492] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7: No bootstrap required, opened a new log
I20260808 07:05:10.606881 876 tablet_bootstrap.cc:492] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f: No bootstrap required, opened a new log
I20260808 07:05:10.606961 876 ts_tablet_manager.cc:1397] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:05:10.606961 877 ts_tablet_manager.cc:1397] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:10.608851 876 raft_consensus.cc:348] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } }
I20260808 07:05:10.608851 877 raft_consensus.cc:348] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } }
I20260808 07:05:10.609036 877 raft_consensus.cc:374] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:10.609036 876 raft_consensus.cc:374] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:10.609081 876 raft_consensus.cc:729] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28ac3a013dd40ec9b807604646f811f, State: Initialized, Role: FOLLOWER
I20260808 07:05:10.609081 877 raft_consensus.cc:729] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21305fb26d5e4eaea9c89380a3659af7, State: Initialized, Role: FOLLOWER
I20260808 07:05:10.609023 880 tablet_bootstrap.cc:492] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a: Bootstrap starting.
I20260808 07:05:10.609234 877 consensus_queue.cc:260] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } }
I20260808 07:05:10.609226 876 consensus_queue.cc:260] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } }
I20260808 07:05:10.609501 876 ts_tablet_manager.cc:1428] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:05:10.609501 877 ts_tablet_manager.cc:1428] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:05:10.609655 840 heartbeater.cc:503] Master 127.29.82.126:44653 was elected leader, sending a full tablet report...
I20260808 07:05:10.609862 880 tablet_bootstrap.cc:654] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:10.609957 393 heartbeater.cc:503] Master 127.29.82.126:44653 was elected leader, sending a full tablet report...
I20260808 07:05:10.610168 880 log.cc:824] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:10.610965 880 tablet_bootstrap.cc:492] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a: No bootstrap required, opened a new log
I20260808 07:05:10.611050 880 ts_tablet_manager.cc:1397] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:10.612488 880 raft_consensus.cc:348] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } }
I20260808 07:05:10.612659 880 raft_consensus.cc:374] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:10.612704 880 raft_consensus.cc:729] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 072b97f76da746d8b20c9409b2bd5e7a, State: Initialized, Role: FOLLOWER
I20260808 07:05:10.612819 880 consensus_queue.cc:260] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } }
I20260808 07:05:10.613054 880 ts_tablet_manager.cc:1428] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:05:10.613106 613 heartbeater.cc:503] Master 127.29.82.126:44653 was elected leader, sending a full tablet report...
W20260808 07:05:10.640843 614 tablet.cc:2369] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:10.724852 882 raft_consensus.cc:482] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:10.725005 882 raft_consensus.cc:504] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } }
I20260808 07:05:10.725399 882 leader_election.cc:288] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007), 21305fb26d5e4eaea9c89380a3659af7 (127.29.82.65:39321)
I20260808 07:05:10.728245 871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.725733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:46763 (local address 127.29.82.66:42007)
0808 07:05:10.725793 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.725795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.725806 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:05:10.725839 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.725840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.725850 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.725928 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:10.726089 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.726594 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.727560 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.727925 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.727988 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.727997 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.728144 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.728178 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:05:10.728245 665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.725663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:42007 (local address 127.29.82.67:46763)
0808 07:05:10.725722 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.725734 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.725781 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.725935 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.725936 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.725938 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:10.726022 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.726024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.726676 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.726677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.727470 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.727472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.728006 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.728007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.728081 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.728084 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.728129 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.728169 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":47}
I20260808 07:05:10.728293 875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.725859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:47925 (local address 127.29.82.65:39321)
0808 07:05:10.725934 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.725936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.726025 (+ 89us) server_negotiation.cc:407] Connection header received
0808 07:05:10.726072 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.726073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.726082 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.726128 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:10.726275 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.726729 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.727627 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.727987 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.728046 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.728055 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.728200 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.728231 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 07:05:10.728355 886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.725789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:39321 (local address 127.29.82.67:47925)
0808 07:05:10.725962 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.725970 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.726022 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.726140 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.726141 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.726142 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:10.726220 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.726221 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.726803 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.726804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.727543 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.727545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.728061 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.728062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.728141 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.728144 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.728188 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.728226 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":104,"threads_started":1}
I20260808 07:05:10.728616 328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "813ab033fcbf47a8800b6dc5ade7df20" candidate_uuid: "e28ac3a013dd40ec9b807604646f811f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21305fb26d5e4eaea9c89380a3659af7" is_pre_election: true
I20260808 07:05:10.728627 541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "813ab033fcbf47a8800b6dc5ade7df20" candidate_uuid: "e28ac3a013dd40ec9b807604646f811f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "072b97f76da746d8b20c9409b2bd5e7a" is_pre_election: true
I20260808 07:05:10.728763 541 raft_consensus.cc:2454] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28ac3a013dd40ec9b807604646f811f in term 0.
I20260808 07:05:10.728765 328 raft_consensus.cc:2454] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28ac3a013dd40ec9b807604646f811f in term 0.
I20260808 07:05:10.729012 653 leader_election.cc:302] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 072b97f76da746d8b20c9409b2bd5e7a, e28ac3a013dd40ec9b807604646f811f; no voters:
I20260808 07:05:10.729184 882 raft_consensus.cc:2781] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:10.729244 882 raft_consensus.cc:482] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:10.729269 882 raft_consensus.cc:3037] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:10.729946 882 raft_consensus.cc:504] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } }
I20260808 07:05:10.730091 882 leader_election.cc:288] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [CANDIDATE]: Term 1 election: Requested vote from peers 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007), 21305fb26d5e4eaea9c89380a3659af7 (127.29.82.65:39321)
I20260808 07:05:10.730291 541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "813ab033fcbf47a8800b6dc5ade7df20" candidate_uuid: "e28ac3a013dd40ec9b807604646f811f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "072b97f76da746d8b20c9409b2bd5e7a"
I20260808 07:05:10.730309 328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "813ab033fcbf47a8800b6dc5ade7df20" candidate_uuid: "e28ac3a013dd40ec9b807604646f811f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21305fb26d5e4eaea9c89380a3659af7"
I20260808 07:05:10.730378 541 raft_consensus.cc:3037] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:10.730378 328 raft_consensus.cc:3037] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:10.731247 328 raft_consensus.cc:2454] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ac3a013dd40ec9b807604646f811f in term 1.
I20260808 07:05:10.731247 541 raft_consensus.cc:2454] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ac3a013dd40ec9b807604646f811f in term 1.
I20260808 07:05:10.731446 653 leader_election.cc:302] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21305fb26d5e4eaea9c89380a3659af7, e28ac3a013dd40ec9b807604646f811f; no voters:
I20260808 07:05:10.731530 882 raft_consensus.cc:2781] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:10.731678 882 raft_consensus.cc:686] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [term 1 LEADER]: Becoming Leader. State: Replica: e28ac3a013dd40ec9b807604646f811f, State: Running, Role: LEADER
I20260808 07:05:10.731756 882 consensus_queue.cc:237] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } }
I20260808 07:05:10.732625 32562 catalog_manager.cc:5495] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f reported cstate change: term changed from 0 to 1, leader changed from <none> to e28ac3a013dd40ec9b807604646f811f (127.29.82.67). New cstate: current_term: 1 leader_uuid: "e28ac3a013dd40ec9b807604646f811f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } health_report { overall_health: UNKNOWN } } }
W20260808 07:05:10.739789 394 tablet.cc:2369] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 07:05:10 dist-test-slave-rmhg krb5kdc[32501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172710, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:10.785243 32639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.778048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41364 (local address 127.29.82.126:44653)
0808 07:05:10.778145 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.778147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.778212 (+ 65us) server_negotiation.cc:407] Connection header received
0808 07:05:10.778267 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.778268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.778278 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.778329 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:10.778840 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.779331 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.780051 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.780235 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.780282 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.782410 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:10.782412 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:10.782412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:10.782419 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:10.783811 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.784255 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.784256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.784256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.784312 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:10.784574 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:10.784575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:10.784575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:10.784715 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:10.784768 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.784970 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.785111 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":67}
I20260808 07:05:10.785251 898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.777954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:44653 (local address 127.0.0.1:41364)
0808 07:05:10.778140 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.778150 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.778219 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.778383 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.778384 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.778715 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:10.778768 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.778771 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.779409 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.779410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.779973 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.779976 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.780301 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.780302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.780350 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.780862 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:10.780867 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:10.782317 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:10.783939 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:10.783956 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:10.783959 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:10.784185 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:10.784373 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:10.784374 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:10.784374 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:10.784490 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:10.784808 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:10.784817 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:10.784874 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.784943 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.785052 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":102,"threads_started":1}
I20260808 07:05:10.787421 32562 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:41364:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 07:05:10.787698 32562 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:10.789286 301 tablet_service.cc:1467] Processing CreateTablet for tablet 0d4ad8761876478b9f14aa37d6b576f8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=50dc5073fb044dfda94fe5c34eed7f00]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:05:10.789297 738 tablet_service.cc:1467] Processing CreateTablet for tablet 0d4ad8761876478b9f14aa37d6b576f8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=50dc5073fb044dfda94fe5c34eed7f00]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:05:10.789347 515 tablet_service.cc:1467] Processing CreateTablet for tablet 0d4ad8761876478b9f14aa37d6b576f8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=50dc5073fb044dfda94fe5c34eed7f00]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:05:10.789467 738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d4ad8761876478b9f14aa37d6b576f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:10.789467 301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d4ad8761876478b9f14aa37d6b576f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:10.789469 515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d4ad8761876478b9f14aa37d6b576f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:10.790603 877 tablet_bootstrap.cc:492] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7: Bootstrap starting.
I20260808 07:05:10.790936 880 tablet_bootstrap.cc:492] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a: Bootstrap starting.
I20260808 07:05:10.790995 877 tablet_bootstrap.cc:654] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:10.791311 876 tablet_bootstrap.cc:492] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f: Bootstrap starting.
I20260808 07:05:10.791622 880 tablet_bootstrap.cc:654] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:10.791725 876 tablet_bootstrap.cc:654] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:10.791908 877 tablet_bootstrap.cc:492] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7: No bootstrap required, opened a new log
I20260808 07:05:10.791960 877 ts_tablet_manager.cc:1397] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:10.792135 877 raft_consensus.cc:348] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.792205 880 tablet_bootstrap.cc:492] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a: No bootstrap required, opened a new log
I20260808 07:05:10.792224 877 raft_consensus.cc:374] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:10.792248 877 raft_consensus.cc:729] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21305fb26d5e4eaea9c89380a3659af7, State: Initialized, Role: FOLLOWER
I20260808 07:05:10.792244 880 ts_tablet_manager.cc:1397] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:10.792294 877 consensus_queue.cc:260] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.792411 877 ts_tablet_manager.cc:1428] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:10.792392 880 raft_consensus.cc:348] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.792479 880 raft_consensus.cc:374] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:10.792512 880 raft_consensus.cc:729] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 072b97f76da746d8b20c9409b2bd5e7a, State: Initialized, Role: FOLLOWER
I20260808 07:05:10.792558 880 consensus_queue.cc:260] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.792593 881 tablet_replica.cc:439] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } }
I20260808 07:05:10.792649 876 tablet_bootstrap.cc:492] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f: No bootstrap required, opened a new log
I20260808 07:05:10.792647 880 ts_tablet_manager.cc:1428] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:10.792686 876 ts_tablet_manager.cc:1397] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:10.792680 881 tablet_replica.cc:442] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:05:10.792795 885 tablet_replica.cc:439] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } }
I20260808 07:05:10.792865 885 tablet_replica.cc:442] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:05:10.792833 876 raft_consensus.cc:348] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.792903 876 raft_consensus.cc:374] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:10.792922 876 raft_consensus.cc:729] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28ac3a013dd40ec9b807604646f811f, State: Initialized, Role: FOLLOWER
I20260808 07:05:10.792959 876 consensus_queue.cc:260] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.793051 876 ts_tablet_manager.cc:1428] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:10.793077 882 tablet_replica.cc:439] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } }
I20260808 07:05:10.793140 882 tablet_replica.cc:442] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f: This TxnStatusTablet replica's current role is: FOLLOWER
W20260808 07:05:10.804584 842 tablet.cc:2369] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:10.918207 881 raft_consensus.cc:482] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:10.918318 881 raft_consensus.cc:504] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.918691 881 leader_election.cc:288] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007), e28ac3a013dd40ec9b807604646f811f (127.29.82.67:40375)
I20260808 07:05:10.921576 871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.918936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:58217 (local address 127.29.82.66:42007)
0808 07:05:10.918984 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.918995 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.919113 (+ 118us) server_negotiation.cc:407] Connection header received
0808 07:05:10.919177 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.919178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.919187 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.919232 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:10.919355 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.919841 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.920852 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.921251 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.921316 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.921326 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.921462 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.921499 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:05:10.921598 906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.918878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:42007 (local address 127.29.82.65:58217)
0808 07:05:10.919051 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.919059 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.919118 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.919239 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.919240 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.919242 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:10.919303 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.919305 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.919916 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.919917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.920761 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.920764 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.921343 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.921344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.921402 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.921405 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.921451 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.921501 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":41,"thread_start_us":101,"threads_started":1}
I20260808 07:05:10.921815 541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4ad8761876478b9f14aa37d6b576f8" candidate_uuid: "21305fb26d5e4eaea9c89380a3659af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "072b97f76da746d8b20c9409b2bd5e7a" is_pre_election: true
I20260808 07:05:10.921876 872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.918926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:50721 (local address 127.29.82.67:40375)
0808 07:05:10.918978 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.918981 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.919114 (+ 133us) server_negotiation.cc:407] Connection header received
0808 07:05:10.919169 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.919171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.919180 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.919229 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:10.919380 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.919846 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.921114 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.921525 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.921591 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.921599 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.921759 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.921814 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 07:05:10.921903 541 raft_consensus.cc:2454] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21305fb26d5e4eaea9c89380a3659af7 in term 0.
I20260808 07:05:10.922081 908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.918872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:40375 (local address 127.29.82.65:50721)
0808 07:05:10.919043 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.919053 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.919115 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.919236 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.919237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.919239 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:10.919327 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.919328 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.919919 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.919920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.921029 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.921031 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.921597 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.921599 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.921668 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.921672 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.921953 (+ 281us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.921995 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":7,"thread_start_us":99,"threads_started":1}
I20260808 07:05:10.922132 32699 leader_election.cc:302] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 072b97f76da746d8b20c9409b2bd5e7a, 21305fb26d5e4eaea9c89380a3659af7; no voters:
I20260808 07:05:10.922298 881 raft_consensus.cc:2781] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:10.922350 881 raft_consensus.cc:482] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:10.922376 881 raft_consensus.cc:3037] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:10.922403 766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4ad8761876478b9f14aa37d6b576f8" candidate_uuid: "21305fb26d5e4eaea9c89380a3659af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ac3a013dd40ec9b807604646f811f" is_pre_election: true
I20260808 07:05:10.922521 766 raft_consensus.cc:2454] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21305fb26d5e4eaea9c89380a3659af7 in term 0.
I20260808 07:05:10.923219 881 raft_consensus.cc:504] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.923338 881 leader_election.cc:288] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [CANDIDATE]: Term 1 election: Requested vote from peers 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007), e28ac3a013dd40ec9b807604646f811f (127.29.82.67:40375)
I20260808 07:05:10.923482 541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4ad8761876478b9f14aa37d6b576f8" candidate_uuid: "21305fb26d5e4eaea9c89380a3659af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "072b97f76da746d8b20c9409b2bd5e7a"
I20260808 07:05:10.923573 541 raft_consensus.cc:3037] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:10.923563 766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4ad8761876478b9f14aa37d6b576f8" candidate_uuid: "21305fb26d5e4eaea9c89380a3659af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ac3a013dd40ec9b807604646f811f"
I20260808 07:05:10.923637 766 raft_consensus.cc:3037] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:10.924220 541 raft_consensus.cc:2454] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21305fb26d5e4eaea9c89380a3659af7 in term 1.
I20260808 07:05:10.924314 766 raft_consensus.cc:2454] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21305fb26d5e4eaea9c89380a3659af7 in term 1.
I20260808 07:05:10.924430 32699 leader_election.cc:302] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 072b97f76da746d8b20c9409b2bd5e7a, 21305fb26d5e4eaea9c89380a3659af7; no voters:
I20260808 07:05:10.924530 881 raft_consensus.cc:2781] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:10.924670 881 raft_consensus.cc:686] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [term 1 LEADER]: Becoming Leader. State: Replica: 21305fb26d5e4eaea9c89380a3659af7, State: Running, Role: LEADER
I20260808 07:05:10.924763 881 consensus_queue.cc:237] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.925211 909 tablet_replica.cc:439] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7: TxnStatusTablet state changed. Reason: New leader 21305fb26d5e4eaea9c89380a3659af7. Latest consensus state: current_term: 1 leader_uuid: "21305fb26d5e4eaea9c89380a3659af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } }
I20260808 07:05:10.925295 909 tablet_replica.cc:442] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:05:10.925457 911 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 07:05:10.925557 911 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 07:05:10.925660 32562 catalog_manager.cc:5495] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21305fb26d5e4eaea9c89380a3659af7 (127.29.82.65). New cstate: current_term: 1 leader_uuid: "21305fb26d5e4eaea9c89380a3659af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } health_report { overall_health: UNKNOWN } } }
I20260808 07:05:10.940425 875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.937765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34820 (local address 127.29.82.65:39321)
0808 07:05:10.937810 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.937812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.937855 (+ 43us) server_negotiation.cc:407] Connection header received
0808 07:05:10.937964 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.937965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.937981 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.938037 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:10.938170 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.938644 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.939724 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.939905 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.939958 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.940142 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:10.940241 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:10.940293 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.940346 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.940363 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:05:10.940475 898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.937724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:39321 (local address 127.0.0.1:34820)
0808 07:05:10.937812 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.937823 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.937876 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.938053 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.938054 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.938055 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:05:10.938112 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.938115 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.938703 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.938704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.939640 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.939643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.939967 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.939968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.940040 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.940059 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:05:10.940290 (+ 231us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:05:10.940295 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.940344 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.940391 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 07:05:10.942399 766 raft_consensus.cc:1261] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Refusing update from remote peer 21305fb26d5e4eaea9c89380a3659af7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:10.942409 541 raft_consensus.cc:1261] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Refusing update from remote peer 21305fb26d5e4eaea9c89380a3659af7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:10.942749 909 consensus_queue.cc:1035] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:10.942911 881 consensus_queue.cc:1035] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:10.944129 885 tablet_replica.cc:439] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a: TxnStatusTablet state changed. Reason: New leader 21305fb26d5e4eaea9c89380a3659af7. Latest consensus state: current_term: 1 leader_uuid: "21305fb26d5e4eaea9c89380a3659af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } }
I20260808 07:05:10.944221 885 tablet_replica.cc:442] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:05:10.945231 882 tablet_replica.cc:439] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f: TxnStatusTablet state changed. Reason: New leader 21305fb26d5e4eaea9c89380a3659af7. Latest consensus state: current_term: 1 leader_uuid: "21305fb26d5e4eaea9c89380a3659af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } }
I20260808 07:05:10.945315 882 tablet_replica.cc:442] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:05:10.945974 909 tablet_replica.cc:439] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "21305fb26d5e4eaea9c89380a3659af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } }
I20260808 07:05:10.946128 909 tablet_replica.cc:442] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:05:10.946262 882 tablet_replica.cc:439] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "21305fb26d5e4eaea9c89380a3659af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } }
I20260808 07:05:10.946331 882 tablet_replica.cc:442] T 0d4ad8761876478b9f14aa37d6b576f8 P e28ac3a013dd40ec9b807604646f811f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:05:10.946540 917 mvcc.cc:205] Tried to move back new op lower bound from 7316163424017395712 to 7316163423948406784. Current Snapshot: MvccSnapshot[applied={T|T < 7316163424017395712}]
I20260808 07:05:10.946600 885 tablet_replica.cc:439] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "21305fb26d5e4eaea9c89380a3659af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } }
I20260808 07:05:10.946671 885 tablet_replica.cc:442] T 0d4ad8761876478b9f14aa37d6b576f8 P 072b97f76da746d8b20c9409b2bd5e7a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:05:10.946817 919 mvcc.cc:205] Tried to move back new op lower bound from 7316163424017395712 to 7316163423948406784. Current Snapshot: MvccSnapshot[applied={T|T < 7316163424017395712}]
I20260808 07:05:10.945995 921 tablet_replica.cc:439] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "21305fb26d5e4eaea9c89380a3659af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } } }
I20260808 07:05:10.947436 921 tablet_replica.cc:442] T 0d4ad8761876478b9f14aa37d6b576f8 P 21305fb26d5e4eaea9c89380a3659af7: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:05:10.951304 872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.948725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32854 (local address 127.29.82.67:40375)
0808 07:05:10.948764 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.948766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.948774 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:10.948831 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.948831 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.948849 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.948909 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:10.949064 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.949725 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.950598 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.950812 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.950866 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.951015 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:10.951111 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:10.951177 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.951214 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.951236 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:05:10.956063 875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.953566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:48215 (local address 127.29.82.65:39321)
0808 07:05:10.953602 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.953603 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.953649 (+ 46us) server_negotiation.cc:407] Connection header received
0808 07:05:10.953718 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.953719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.953726 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.953768 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:10.953892 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.954330 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.955403 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.955596 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.955658 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.955863 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:10.955890 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:10.955925 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.955991 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.956008 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:05:10.956110 855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.953519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:39321 (local address 127.29.82.67:48215)
0808 07:05:10.953595 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.953607 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.953663 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.953782 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.953783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.953784 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:05:10.953842 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.953843 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.954390 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.954392 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.955325 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.955327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.955663 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.955664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.955730 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.955767 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:05:10.955940 (+ 173us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:05:10.955942 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.955988 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.956033 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 07:05:10.958830 541 raft_consensus.cc:1261] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Refusing update from remote peer e28ac3a013dd40ec9b807604646f811f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:10.958884 328 raft_consensus.cc:1261] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Refusing update from remote peer e28ac3a013dd40ec9b807604646f811f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:10.959131 887 consensus_queue.cc:1035] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:10.959259 882 consensus_queue.cc:1035] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [LEADER]: Connected to new peer: Peer: permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:10.961557 916 mvcc.cc:205] Tried to move back new op lower bound from 7316163424085528576 to 7316163423157903360. Current Snapshot: MvccSnapshot[applied={T|T < 7316163424085528576}]
I20260808 07:05:10.968333 872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.965809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:32861 (local address 127.29.82.67:40375)
0808 07:05:10.965848 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:10.965851 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:10.965914 (+ 63us) server_negotiation.cc:407] Connection header received
0808 07:05:10.966008 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:10.966009 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:10.966020 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:10.966071 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:10.966201 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.966685 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.967605 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.967873 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.967932 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.968095 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:10.968131 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:10.968174 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:10.968226 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 07:05:10.968249 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:05:10.968369 939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:10.965662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:40375 (local address 127.29.82.65:32861)
0808 07:05:10.965852 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:10.965863 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:10.965949 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:10.966075 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:10.966076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:10.966077 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:05:10.966148 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.966150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.966757 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.966758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.967537 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:10.967539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:10.967939 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:10.967941 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:10.968008 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:10.968026 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:05:10.968183 (+ 157us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:05:10.968185 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:05:10.968225 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 07:05:10.968272 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":97,"threads_started":1}
I20260808 07:05:10.977988 32563 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:10.978113 32563 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:10.978895 32563 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703: Sending DeleteTablet for 3 replicas of tablet 813ab033fcbf47a8800b6dc5ade7df20
I20260808 07:05:10.979220 738 tablet_service.cc:1514] Processing DeleteTablet for tablet 813ab033fcbf47a8800b6dc5ade7df20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:10 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:32840
I20260808 07:05:10.979367 301 tablet_service.cc:1514] Processing DeleteTablet for tablet 813ab033fcbf47a8800b6dc5ade7df20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:10 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:34810
I20260808 07:05:10.979658 943 tablet_replica.cc:330] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f: stopping tablet replica
I20260808 07:05:10.979799 943 raft_consensus.cc:2229] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:05:10.979827 515 tablet_service.cc:1514] Processing DeleteTablet for tablet 813ab033fcbf47a8800b6dc5ade7df20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:10 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:38964
I20260808 07:05:10.980013 943 raft_consensus.cc:2258] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:10.980103 32563 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:10.980265 32563 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:10.980497 944 tablet_replica.cc:330] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7: stopping tablet replica
I20260808 07:05:10.980618 944 raft_consensus.cc:2229] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:10.980669 944 raft_consensus.cc:2258] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:10.981212 946 tablet_replica.cc:330] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a: stopping tablet replica
I20260808 07:05:10.981333 946 raft_consensus.cc:2229] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:10.981398 946 raft_consensus.cc:2258] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:10.982151 943 ts_tablet_manager.cc:1905] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:10.982174 301 tablet_service.cc:1467] Processing CreateTablet for tablet a33f0b3bd54d47ee94c279b7dd0ba5e1 (DEFAULT_TABLE table=test-table [id=8cd864986df54525876fc905062b9994]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:10.982308 301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a33f0b3bd54d47ee94c279b7dd0ba5e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:10.983754 515 tablet_service.cc:1467] Processing CreateTablet for tablet a33f0b3bd54d47ee94c279b7dd0ba5e1 (DEFAULT_TABLE table=test-table [id=8cd864986df54525876fc905062b9994]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:10.983892 515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a33f0b3bd54d47ee94c279b7dd0ba5e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:10.984157 943 ts_tablet_manager.cc:1918] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:05:10.984251 946 ts_tablet_manager.cc:1905] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:10.984268 943 log.cc:1196] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/813ab033fcbf47a8800b6dc5ade7df20
I20260808 07:05:10.984650 943 ts_tablet_manager.cc:1939] T 813ab033fcbf47a8800b6dc5ade7df20 P e28ac3a013dd40ec9b807604646f811f: Deleting consensus metadata
I20260808 07:05:10.985183 32544 catalog_manager.cc:4841] TS e28ac3a013dd40ec9b807604646f811f (127.29.82.67:40375): tablet 813ab033fcbf47a8800b6dc5ade7df20 (table test-table [id=9d53629e2174416686ddf9ce15c7dda6]) successfully deleted
I20260808 07:05:10.985349 738 tablet_service.cc:1467] Processing CreateTablet for tablet a33f0b3bd54d47ee94c279b7dd0ba5e1 (DEFAULT_TABLE table=test-table [id=8cd864986df54525876fc905062b9994]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:10.985473 738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a33f0b3bd54d47ee94c279b7dd0ba5e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:10.985931 946 ts_tablet_manager.cc:1918] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:05:10.986047 946 log.cc:1196] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/813ab033fcbf47a8800b6dc5ade7df20
I20260808 07:05:10.986348 946 ts_tablet_manager.cc:1939] T 813ab033fcbf47a8800b6dc5ade7df20 P 072b97f76da746d8b20c9409b2bd5e7a: Deleting consensus metadata
I20260808 07:05:10.986666 877 tablet_bootstrap.cc:492] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7: Bootstrap starting.
I20260808 07:05:10.987043 877 tablet_bootstrap.cc:654] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:10.987486 880 tablet_bootstrap.cc:492] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a: Bootstrap starting.
I20260808 07:05:10.987875 880 tablet_bootstrap.cc:654] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:10.988233 876 tablet_bootstrap.cc:492] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f: Bootstrap starting.
I20260808 07:05:10.988628 876 tablet_bootstrap.cc:654] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:10.989109 32541 catalog_manager.cc:4841] TS 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007): tablet 813ab033fcbf47a8800b6dc5ade7df20 (table test-table [id=9d53629e2174416686ddf9ce15c7dda6]) successfully deleted
I20260808 07:05:10.989571 876 tablet_bootstrap.cc:492] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f: No bootstrap required, opened a new log
I20260808 07:05:10.989621 876 ts_tablet_manager.cc:1397] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:10.989758 876 raft_consensus.cc:348] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.989831 876 raft_consensus.cc:374] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:10.989850 876 raft_consensus.cc:729] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28ac3a013dd40ec9b807604646f811f, State: Initialized, Role: FOLLOWER
I20260808 07:05:10.989897 876 consensus_queue.cc:260] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.989986 876 ts_tablet_manager.cc:1428] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:10.990252 877 tablet_bootstrap.cc:492] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7: No bootstrap required, opened a new log
I20260808 07:05:10.990300 877 ts_tablet_manager.cc:1397] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 07:05:10.990446 877 raft_consensus.cc:348] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.990505 877 raft_consensus.cc:374] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:10.990523 877 raft_consensus.cc:729] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21305fb26d5e4eaea9c89380a3659af7, State: Initialized, Role: FOLLOWER
I20260808 07:05:10.990562 877 consensus_queue.cc:260] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.990651 877 ts_tablet_manager.cc:1428] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:10.990866 880 tablet_bootstrap.cc:492] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a: No bootstrap required, opened a new log
I20260808 07:05:10.990907 880 ts_tablet_manager.cc:1397] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:05:10.991041 880 raft_consensus.cc:348] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.991107 880 raft_consensus.cc:374] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:10.991127 880 raft_consensus.cc:729] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 072b97f76da746d8b20c9409b2bd5e7a, State: Initialized, Role: FOLLOWER
I20260808 07:05:10.991168 880 consensus_queue.cc:260] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:10.991245 880 ts_tablet_manager.cc:1428] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:10.991828 944 ts_tablet_manager.cc:1905] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:10.993800 944 ts_tablet_manager.cc:1918] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:05:10.993875 944 log.cc:1196] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/wal/wals/813ab033fcbf47a8800b6dc5ade7df20
I20260808 07:05:10.994133 944 ts_tablet_manager.cc:1939] T 813ab033fcbf47a8800b6dc5ade7df20 P 21305fb26d5e4eaea9c89380a3659af7: Deleting consensus metadata
I20260808 07:05:10.994540 32541 catalog_manager.cc:4841] TS 21305fb26d5e4eaea9c89380a3659af7 (127.29.82.65:39321): tablet 813ab033fcbf47a8800b6dc5ade7df20 (table test-table [id=9d53629e2174416686ddf9ce15c7dda6]) successfully deleted
I20260808 07:05:11.116937 940 raft_consensus.cc:482] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:11.117048 940 raft_consensus.cc:504] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:11.117221 940 leader_election.cc:288] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21305fb26d5e4eaea9c89380a3659af7 (127.29.82.65:39321), 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007)
I20260808 07:05:11.117450 328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a33f0b3bd54d47ee94c279b7dd0ba5e1" candidate_uuid: "e28ac3a013dd40ec9b807604646f811f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21305fb26d5e4eaea9c89380a3659af7" is_pre_election: true
I20260808 07:05:11.117568 328 raft_consensus.cc:2454] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28ac3a013dd40ec9b807604646f811f in term 0.
I20260808 07:05:11.117604 541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a33f0b3bd54d47ee94c279b7dd0ba5e1" candidate_uuid: "e28ac3a013dd40ec9b807604646f811f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "072b97f76da746d8b20c9409b2bd5e7a" is_pre_election: true
I20260808 07:05:11.117699 541 raft_consensus.cc:2454] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28ac3a013dd40ec9b807604646f811f in term 0.
I20260808 07:05:11.117746 653 leader_election.cc:302] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21305fb26d5e4eaea9c89380a3659af7, e28ac3a013dd40ec9b807604646f811f; no voters:
I20260808 07:05:11.117856 940 raft_consensus.cc:2781] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:11.117911 940 raft_consensus.cc:482] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:11.117928 940 raft_consensus.cc:3037] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:11.118726 940 raft_consensus.cc:504] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:11.118847 940 leader_election.cc:288] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [CANDIDATE]: Term 1 election: Requested vote from peers 21305fb26d5e4eaea9c89380a3659af7 (127.29.82.65:39321), 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007)
I20260808 07:05:11.119033 328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a33f0b3bd54d47ee94c279b7dd0ba5e1" candidate_uuid: "e28ac3a013dd40ec9b807604646f811f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21305fb26d5e4eaea9c89380a3659af7"
I20260808 07:05:11.119112 328 raft_consensus.cc:3037] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:11.119082 541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a33f0b3bd54d47ee94c279b7dd0ba5e1" candidate_uuid: "e28ac3a013dd40ec9b807604646f811f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "072b97f76da746d8b20c9409b2bd5e7a"
I20260808 07:05:11.119179 541 raft_consensus.cc:3037] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:11.119699 328 raft_consensus.cc:2454] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ac3a013dd40ec9b807604646f811f in term 1.
I20260808 07:05:11.119874 541 raft_consensus.cc:2454] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ac3a013dd40ec9b807604646f811f in term 1.
I20260808 07:05:11.119871 653 leader_election.cc:302] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21305fb26d5e4eaea9c89380a3659af7, e28ac3a013dd40ec9b807604646f811f; no voters:
I20260808 07:05:11.119978 940 raft_consensus.cc:2781] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:11.120023 940 raft_consensus.cc:686] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [term 1 LEADER]: Becoming Leader. State: Replica: e28ac3a013dd40ec9b807604646f811f, State: Running, Role: LEADER
I20260808 07:05:11.120065 940 consensus_queue.cc:237] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:11.120664 32562 catalog_manager.cc:5495] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f reported cstate change: term changed from 0 to 1, leader changed from <none> to e28ac3a013dd40ec9b807604646f811f (127.29.82.67). New cstate: current_term: 1 leader_uuid: "e28ac3a013dd40ec9b807604646f811f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } health_report { overall_health: HEALTHY } } }
I20260808 07:05:11.143721 541 raft_consensus.cc:1261] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Refusing update from remote peer e28ac3a013dd40ec9b807604646f811f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:11.143765 328 raft_consensus.cc:1261] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Refusing update from remote peer e28ac3a013dd40ec9b807604646f811f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:11.143980 940 consensus_queue.cc:1035] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:11.144095 887 consensus_queue.cc:1035] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [LEADER]: Connected to new peer: Peer: permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 07:05:11.148515 919 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 07:05:12.666546 32559 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:12.666658 32559 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:12.667618 32559 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703: Sending DeleteTablet for 3 replicas of tablet a33f0b3bd54d47ee94c279b7dd0ba5e1
I20260808 07:05:12.667917 738 tablet_service.cc:1514] Processing DeleteTablet for tablet a33f0b3bd54d47ee94c279b7dd0ba5e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:12 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:32840
I20260808 07:05:12.667917 301 tablet_service.cc:1514] Processing DeleteTablet for tablet a33f0b3bd54d47ee94c279b7dd0ba5e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:12 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:34810
I20260808 07:05:12.667945 515 tablet_service.cc:1514] Processing DeleteTablet for tablet a33f0b3bd54d47ee94c279b7dd0ba5e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:12 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:38964
I20260808 07:05:12.668192 998 tablet_replica.cc:330] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a: stopping tablet replica
I20260808 07:05:12.668260 998 raft_consensus.cc:2229] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:12.668304 998 raft_consensus.cc:2258] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:12.668530 998 ts_tablet_manager.cc:1905] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:12.670138 998 ts_tablet_manager.cc:1918] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:05:12.670209 998 log.cc:1196] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/a33f0b3bd54d47ee94c279b7dd0ba5e1
I20260808 07:05:12.670423 998 ts_tablet_manager.cc:1939] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 072b97f76da746d8b20c9409b2bd5e7a: Deleting consensus metadata
I20260808 07:05:12.671000 994 tablet_replica.cc:330] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7: stopping tablet replica
I20260808 07:05:12.671061 994 raft_consensus.cc:2229] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:12.671093 994 raft_consensus.cc:2258] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:12.671200 997 tablet_replica.cc:330] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f: stopping tablet replica
I20260808 07:05:12.671254 997 raft_consensus.cc:2229] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:05:12.671314 997 raft_consensus.cc:2258] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:12.671355 994 ts_tablet_manager.cc:1905] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:12.671576 997 ts_tablet_manager.cc:1905] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:12.678187 997 ts_tablet_manager.cc:1918] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:05:12.678218 994 ts_tablet_manager.cc:1918] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:05:12.678270 997 log.cc:1196] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/a33f0b3bd54d47ee94c279b7dd0ba5e1
I20260808 07:05:12.678285 994 log.cc:1196] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/wal/wals/a33f0b3bd54d47ee94c279b7dd0ba5e1
I20260808 07:05:12.678421 32541 catalog_manager.cc:4841] TS 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007): tablet a33f0b3bd54d47ee94c279b7dd0ba5e1 (table test-table [id=8cd864986df54525876fc905062b9994]) successfully deleted
I20260808 07:05:12.678526 994 ts_tablet_manager.cc:1939] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P 21305fb26d5e4eaea9c89380a3659af7: Deleting consensus metadata
I20260808 07:05:12.678557 997 ts_tablet_manager.cc:1939] T a33f0b3bd54d47ee94c279b7dd0ba5e1 P e28ac3a013dd40ec9b807604646f811f: Deleting consensus metadata
I20260808 07:05:12.678895 32544 catalog_manager.cc:4841] TS e28ac3a013dd40ec9b807604646f811f (127.29.82.67:40375): tablet a33f0b3bd54d47ee94c279b7dd0ba5e1 (table test-table [id=8cd864986df54525876fc905062b9994]) successfully deleted
I20260808 07:05:12.678946 32541 catalog_manager.cc:4841] TS 21305fb26d5e4eaea9c89380a3659af7 (127.29.82.65:39321): tablet a33f0b3bd54d47ee94c279b7dd0ba5e1 (table test-table [id=8cd864986df54525876fc905062b9994]) successfully deleted
Aug 08 07:05:12 dist-test-slave-rmhg krb5kdc[32501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172712, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:05:12 dist-test-slave-rmhg krb5kdc[32501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172712, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:12.692893 1010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:12.686166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41370 (local address 127.29.82.126:44653)
0808 07:05:12.686325 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:12.686328 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:12.686352 (+ 24us) server_negotiation.cc:407] Connection header received
0808 07:05:12.686380 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:12.686380 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:12.686391 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:12.686444 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:12.687002 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:12.687517 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:12.688250 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:12.688446 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:12.688502 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:12.690736 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:12.690738 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:12.690738 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:12.690745 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:12.691914 (+ 1169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:12.692227 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:12.692228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:12.692228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:12.692283 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:12.692417 (+ 134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:12.692418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:12.692418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:12.692518 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:12.692591 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:12.692749 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 07:05:12.692819 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":85,"threads_started":1}
I20260808 07:05:12.694486 32559 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:12.694670 32559 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:12.696064 301 tablet_service.cc:1467] Processing CreateTablet for tablet 80f06d548bd94917ac9508e2f4ebf15f (DEFAULT_TABLE table=test-table [id=2e68c0e37b5642a38054a72925f3f7a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:12.696072 515 tablet_service.cc:1467] Processing CreateTablet for tablet 80f06d548bd94917ac9508e2f4ebf15f (DEFAULT_TABLE table=test-table [id=2e68c0e37b5642a38054a72925f3f7a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:12.696203 515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80f06d548bd94917ac9508e2f4ebf15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:12.696208 301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80f06d548bd94917ac9508e2f4ebf15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:12.697252 1011 tablet_bootstrap.cc:492] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a: Bootstrap starting.
I20260808 07:05:12.697286 738 tablet_service.cc:1467] Processing CreateTablet for tablet 80f06d548bd94917ac9508e2f4ebf15f (DEFAULT_TABLE table=test-table [id=2e68c0e37b5642a38054a72925f3f7a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:12.697412 738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80f06d548bd94917ac9508e2f4ebf15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:12.697675 1011 tablet_bootstrap.cc:654] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:12.698293 1011 tablet_bootstrap.cc:492] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a: No bootstrap required, opened a new log
I20260808 07:05:12.698347 1011 ts_tablet_manager.cc:1397] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 07:05:12.698486 1011 raft_consensus.cc:348] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.698567 1011 raft_consensus.cc:374] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:12.698596 1011 raft_consensus.cc:729] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 072b97f76da746d8b20c9409b2bd5e7a, State: Initialized, Role: FOLLOWER
I20260808 07:05:12.698720 1014 tablet_bootstrap.cc:492] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f: Bootstrap starting.
I20260808 07:05:12.698668 1011 consensus_queue.cc:260] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.698825 1012 tablet_bootstrap.cc:492] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7: Bootstrap starting.
I20260808 07:05:12.698932 1011 ts_tablet_manager.cc:1428] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 07:05:12.699151 1014 tablet_bootstrap.cc:654] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:12.699167 1012 tablet_bootstrap.cc:654] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:12.699823 1014 tablet_bootstrap.cc:492] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f: No bootstrap required, opened a new log
I20260808 07:05:12.699878 1014 ts_tablet_manager.cc:1397] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:12.700004 1014 raft_consensus.cc:348] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.700070 1014 raft_consensus.cc:374] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:12.700089 1014 raft_consensus.cc:729] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28ac3a013dd40ec9b807604646f811f, State: Initialized, Role: FOLLOWER
I20260808 07:05:12.700105 1012 tablet_bootstrap.cc:492] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7: No bootstrap required, opened a new log
I20260808 07:05:12.700160 1012 ts_tablet_manager.cc:1397] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:12.700153 1014 consensus_queue.cc:260] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.700244 1014 ts_tablet_manager.cc:1428] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:12.700286 1012 raft_consensus.cc:348] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.700361 1012 raft_consensus.cc:374] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:12.700388 1012 raft_consensus.cc:729] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21305fb26d5e4eaea9c89380a3659af7, State: Initialized, Role: FOLLOWER
I20260808 07:05:12.700429 1012 consensus_queue.cc:260] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.700531 1012 ts_tablet_manager.cc:1428] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:12.761842 969 raft_consensus.cc:482] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:12.761960 969 raft_consensus.cc:504] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.762138 969 leader_election.cc:288] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007), e28ac3a013dd40ec9b807604646f811f (127.29.82.67:40375)
I20260808 07:05:12.762367 766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f06d548bd94917ac9508e2f4ebf15f" candidate_uuid: "21305fb26d5e4eaea9c89380a3659af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ac3a013dd40ec9b807604646f811f" is_pre_election: true
I20260808 07:05:12.762356 541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f06d548bd94917ac9508e2f4ebf15f" candidate_uuid: "21305fb26d5e4eaea9c89380a3659af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "072b97f76da746d8b20c9409b2bd5e7a" is_pre_election: true
I20260808 07:05:12.762470 766 raft_consensus.cc:2454] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21305fb26d5e4eaea9c89380a3659af7 in term 0.
I20260808 07:05:12.762511 541 raft_consensus.cc:2454] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21305fb26d5e4eaea9c89380a3659af7 in term 0.
I20260808 07:05:12.762645 32702 leader_election.cc:302] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21305fb26d5e4eaea9c89380a3659af7, e28ac3a013dd40ec9b807604646f811f; no voters:
I20260808 07:05:12.762761 969 raft_consensus.cc:2781] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:12.762826 969 raft_consensus.cc:482] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:12.762845 969 raft_consensus.cc:3037] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:12.763559 969 raft_consensus.cc:504] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.763685 969 leader_election.cc:288] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [CANDIDATE]: Term 1 election: Requested vote from peers 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007), e28ac3a013dd40ec9b807604646f811f (127.29.82.67:40375)
I20260808 07:05:12.763846 541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f06d548bd94917ac9508e2f4ebf15f" candidate_uuid: "21305fb26d5e4eaea9c89380a3659af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "072b97f76da746d8b20c9409b2bd5e7a"
I20260808 07:05:12.763927 541 raft_consensus.cc:3037] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:12.763885 766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f06d548bd94917ac9508e2f4ebf15f" candidate_uuid: "21305fb26d5e4eaea9c89380a3659af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ac3a013dd40ec9b807604646f811f"
I20260808 07:05:12.763996 766 raft_consensus.cc:3037] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:12.764494 541 raft_consensus.cc:2454] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21305fb26d5e4eaea9c89380a3659af7 in term 1.
I20260808 07:05:12.764681 766 raft_consensus.cc:2454] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21305fb26d5e4eaea9c89380a3659af7 in term 1.
I20260808 07:05:12.764683 32699 leader_election.cc:302] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 072b97f76da746d8b20c9409b2bd5e7a, 21305fb26d5e4eaea9c89380a3659af7; no voters:
I20260808 07:05:12.764787 969 raft_consensus.cc:2781] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:12.764851 969 raft_consensus.cc:686] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [term 1 LEADER]: Becoming Leader. State: Replica: 21305fb26d5e4eaea9c89380a3659af7, State: Running, Role: LEADER
I20260808 07:05:12.764906 969 consensus_queue.cc:237] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.765559 32562 catalog_manager.cc:5495] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21305fb26d5e4eaea9c89380a3659af7 (127.29.82.65). New cstate: current_term: 1 leader_uuid: "21305fb26d5e4eaea9c89380a3659af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } health_report { overall_health: UNKNOWN } } }
I20260808 07:05:12.775221 1024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:12.772899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34834 (local address 127.29.82.65:39321)
0808 07:05:12.773061 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:12.773063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:12.773070 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:05:12.773090 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:12.773090 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:12.773099 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:12.773188 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:12.773330 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:12.773831 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:12.774596 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:12.774800 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:12.774854 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:12.774987 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:12.775021 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:12.775061 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:12.775110 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 07:05:12.775141 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":109,"threads_started":1}
I20260808 07:05:12.779237 1024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:12.777296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:38565 (local address 127.29.82.65:39321)
0808 07:05:12.777343 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:12.777345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:12.777420 (+ 75us) server_negotiation.cc:407] Connection header received
0808 07:05:12.777469 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:12.777470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:12.777477 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:12.777517 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:12.777606 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:12.778038 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:12.778748 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:12.778923 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:12.778967 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:12.779055 (+ 88us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:12.779078 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:12.779107 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:12.779146 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 07:05:12.779160 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:05:12.779249 1030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:12.777239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:39321 (local address 127.29.82.65:38565)
0808 07:05:12.777370 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:12.777379 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:12.777432 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:12.777531 (+ 99us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:12.777531 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:12.777533 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:05:12.777573 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:12.777574 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:12.778105 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:12.778106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:12.778688 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:12.778690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:12.778972 (+ 282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:12.778973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:12.779010 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:12.779014 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:05:12.779108 (+ 94us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:05:12.779117 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 07:05:12.779144 (+ 27us) client_negotiation.cc:240] Negotiation successful
0808 07:05:12.779175 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":69,"threads_started":1}
I20260808 07:05:12.781184 766 raft_consensus.cc:1261] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Refusing update from remote peer 21305fb26d5e4eaea9c89380a3659af7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:12.781194 541 raft_consensus.cc:1261] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Refusing update from remote peer 21305fb26d5e4eaea9c89380a3659af7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:12.781402 956 consensus_queue.cc:1035] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:12.781508 969 consensus_queue.cc:1035] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:12.791911 32559 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:12.792021 32559 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:12.792645 32559 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703: Sending DeleteTablet for 3 replicas of tablet 80f06d548bd94917ac9508e2f4ebf15f
I20260808 07:05:12.792897 738 tablet_service.cc:1514] Processing DeleteTablet for tablet 80f06d548bd94917ac9508e2f4ebf15f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:12 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:32840
I20260808 07:05:12.792905 515 tablet_service.cc:1514] Processing DeleteTablet for tablet 80f06d548bd94917ac9508e2f4ebf15f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:12 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:38964
I20260808 07:05:12.793022 998 tablet_replica.cc:330] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a: stopping tablet replica
I20260808 07:05:12.793023 997 tablet_replica.cc:330] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f: stopping tablet replica
I20260808 07:05:12.793084 998 raft_consensus.cc:2229] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:12.793087 997 raft_consensus.cc:2229] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:12.793123 997 raft_consensus.cc:2258] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:12.793121 998 raft_consensus.cc:2258] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:12.793280 300 tablet_service.cc:1514] Processing DeleteTablet for tablet 80f06d548bd94917ac9508e2f4ebf15f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:12 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:34810
I20260808 07:05:12.793406 994 tablet_replica.cc:330] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7: stopping tablet replica
I20260808 07:05:12.793460 994 raft_consensus.cc:2229] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:05:12.793542 998 ts_tablet_manager.cc:1905] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:12.793562 994 raft_consensus.cc:2258] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:12.793551 997 ts_tablet_manager.cc:1905] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:12.793972 994 ts_tablet_manager.cc:1905] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:12.795089 998 ts_tablet_manager.cc:1918] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:05:12.795142 998 log.cc:1196] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/80f06d548bd94917ac9508e2f4ebf15f
I20260808 07:05:12.795158 997 ts_tablet_manager.cc:1918] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:05:12.795209 997 log.cc:1196] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/80f06d548bd94917ac9508e2f4ebf15f
I20260808 07:05:12.795352 998 ts_tablet_manager.cc:1939] T 80f06d548bd94917ac9508e2f4ebf15f P 072b97f76da746d8b20c9409b2bd5e7a: Deleting consensus metadata
I20260808 07:05:12.795413 997 ts_tablet_manager.cc:1939] T 80f06d548bd94917ac9508e2f4ebf15f P e28ac3a013dd40ec9b807604646f811f: Deleting consensus metadata
I20260808 07:05:12.795527 994 ts_tablet_manager.cc:1918] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:05:12.795576 994 log.cc:1196] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-0/wal/wals/80f06d548bd94917ac9508e2f4ebf15f
I20260808 07:05:12.795753 994 ts_tablet_manager.cc:1939] T 80f06d548bd94917ac9508e2f4ebf15f P 21305fb26d5e4eaea9c89380a3659af7: Deleting consensus metadata
I20260808 07:05:12.795822 32544 catalog_manager.cc:4841] TS e28ac3a013dd40ec9b807604646f811f (127.29.82.67:40375): tablet 80f06d548bd94917ac9508e2f4ebf15f (table test-table [id=2e68c0e37b5642a38054a72925f3f7a7]) successfully deleted
I20260808 07:05:12.795910 32541 catalog_manager.cc:4841] TS 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007): tablet 80f06d548bd94917ac9508e2f4ebf15f (table test-table [id=2e68c0e37b5642a38054a72925f3f7a7]) successfully deleted
I20260808 07:05:12.796097 32559 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 07:05:12.796211 32541 catalog_manager.cc:4841] TS 21305fb26d5e4eaea9c89380a3659af7 (127.29.82.65:39321): tablet 80f06d548bd94917ac9508e2f4ebf15f (table test-table [id=2e68c0e37b5642a38054a72925f3f7a7]) successfully deleted
W20260808 07:05:12.796267 32559 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:12.797550 738 tablet_service.cc:1467] Processing CreateTablet for tablet c0ef481e23064506a5f423068aa9ddd8 (DEFAULT_TABLE table=test-table [id=ef43eeef023b4b5f89537b72e1b64f4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:12.797559 515 tablet_service.cc:1467] Processing CreateTablet for tablet c0ef481e23064506a5f423068aa9ddd8 (DEFAULT_TABLE table=test-table [id=ef43eeef023b4b5f89537b72e1b64f4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:12.797571 300 tablet_service.cc:1467] Processing CreateTablet for tablet c0ef481e23064506a5f423068aa9ddd8 (DEFAULT_TABLE table=test-table [id=ef43eeef023b4b5f89537b72e1b64f4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:12.797663 515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0ef481e23064506a5f423068aa9ddd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:12.797663 738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0ef481e23064506a5f423068aa9ddd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:12.797693 300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0ef481e23064506a5f423068aa9ddd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:12.798791 1011 tablet_bootstrap.cc:492] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a: Bootstrap starting.
I20260808 07:05:12.798874 1012 tablet_bootstrap.cc:492] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7: Bootstrap starting.
I20260808 07:05:12.799213 1012 tablet_bootstrap.cc:654] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:12.799371 1011 tablet_bootstrap.cc:654] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:12.799685 1014 tablet_bootstrap.cc:492] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f: Bootstrap starting.
I20260808 07:05:12.799773 1012 tablet_bootstrap.cc:492] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7: No bootstrap required, opened a new log
I20260808 07:05:12.799816 1012 ts_tablet_manager.cc:1397] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:12.799945 1012 raft_consensus.cc:348] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.799990 1014 tablet_bootstrap.cc:654] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:12.800010 1012 raft_consensus.cc:374] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:12.800029 1012 raft_consensus.cc:729] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21305fb26d5e4eaea9c89380a3659af7, State: Initialized, Role: FOLLOWER
I20260808 07:05:12.800083 1012 consensus_queue.cc:260] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.800175 1012 ts_tablet_manager.cc:1428] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:12.800516 1011 tablet_bootstrap.cc:492] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a: No bootstrap required, opened a new log
I20260808 07:05:12.800565 1011 ts_tablet_manager.cc:1397] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:05:12.800704 1011 raft_consensus.cc:348] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.800761 1011 raft_consensus.cc:374] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:12.800778 1011 raft_consensus.cc:729] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 072b97f76da746d8b20c9409b2bd5e7a, State: Initialized, Role: FOLLOWER
I20260808 07:05:12.800818 1011 consensus_queue.cc:260] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.801026 1011 ts_tablet_manager.cc:1428] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:12.801420 1014 tablet_bootstrap.cc:492] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f: No bootstrap required, opened a new log
I20260808 07:05:12.801465 1014 ts_tablet_manager.cc:1397] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:12.801578 1014 raft_consensus.cc:348] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.801646 1014 raft_consensus.cc:374] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:12.801666 1014 raft_consensus.cc:729] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28ac3a013dd40ec9b807604646f811f, State: Initialized, Role: FOLLOWER
I20260808 07:05:12.801710 1014 consensus_queue.cc:260] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.801802 1014 ts_tablet_manager.cc:1428] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:12.856706 1035 raft_consensus.cc:482] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:12.856806 1035 raft_consensus.cc:504] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.856997 1035 leader_election.cc:288] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007), e28ac3a013dd40ec9b807604646f811f (127.29.82.67:40375)
I20260808 07:05:12.857244 541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0ef481e23064506a5f423068aa9ddd8" candidate_uuid: "21305fb26d5e4eaea9c89380a3659af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "072b97f76da746d8b20c9409b2bd5e7a" is_pre_election: true
I20260808 07:05:12.857355 541 raft_consensus.cc:2454] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21305fb26d5e4eaea9c89380a3659af7 in term 0.
I20260808 07:05:12.857329 766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0ef481e23064506a5f423068aa9ddd8" candidate_uuid: "21305fb26d5e4eaea9c89380a3659af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ac3a013dd40ec9b807604646f811f" is_pre_election: true
I20260808 07:05:12.857407 766 raft_consensus.cc:2454] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21305fb26d5e4eaea9c89380a3659af7 in term 0.
I20260808 07:05:12.857558 32702 leader_election.cc:302] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21305fb26d5e4eaea9c89380a3659af7, e28ac3a013dd40ec9b807604646f811f; no voters:
I20260808 07:05:12.857707 1035 raft_consensus.cc:2781] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:12.857749 1035 raft_consensus.cc:482] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:12.857770 1035 raft_consensus.cc:3037] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:12.858647 1035 raft_consensus.cc:504] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.858847 1035 leader_election.cc:288] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [CANDIDATE]: Term 1 election: Requested vote from peers 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007), e28ac3a013dd40ec9b807604646f811f (127.29.82.67:40375)
I20260808 07:05:12.858930 766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0ef481e23064506a5f423068aa9ddd8" candidate_uuid: "21305fb26d5e4eaea9c89380a3659af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ac3a013dd40ec9b807604646f811f"
I20260808 07:05:12.858958 541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0ef481e23064506a5f423068aa9ddd8" candidate_uuid: "21305fb26d5e4eaea9c89380a3659af7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "072b97f76da746d8b20c9409b2bd5e7a"
I20260808 07:05:12.859005 766 raft_consensus.cc:3037] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:12.859038 541 raft_consensus.cc:3037] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:12.859596 766 raft_consensus.cc:2454] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21305fb26d5e4eaea9c89380a3659af7 in term 1.
I20260808 07:05:12.859776 32702 leader_election.cc:302] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21305fb26d5e4eaea9c89380a3659af7, e28ac3a013dd40ec9b807604646f811f; no voters:
I20260808 07:05:12.859855 1035 raft_consensus.cc:2781] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:12.859855 541 raft_consensus.cc:2454] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21305fb26d5e4eaea9c89380a3659af7 in term 1.
I20260808 07:05:12.860009 1035 raft_consensus.cc:686] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [term 1 LEADER]: Becoming Leader. State: Replica: 21305fb26d5e4eaea9c89380a3659af7, State: Running, Role: LEADER
I20260808 07:05:12.860067 1035 consensus_queue.cc:237] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } }
I20260808 07:05:12.860690 32562 catalog_manager.cc:5495] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21305fb26d5e4eaea9c89380a3659af7 (127.29.82.65). New cstate: current_term: 1 leader_uuid: "21305fb26d5e4eaea9c89380a3659af7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21305fb26d5e4eaea9c89380a3659af7" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 } health_report { overall_health: UNKNOWN } } }
I20260808 07:05:12.876643 541 raft_consensus.cc:1261] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Refusing update from remote peer 21305fb26d5e4eaea9c89380a3659af7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:12.876668 766 raft_consensus.cc:1261] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Refusing update from remote peer 21305fb26d5e4eaea9c89380a3659af7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:12.876874 1035 consensus_queue.cc:1035] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "072b97f76da746d8b20c9409b2bd5e7a" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 42007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:12.877009 956 consensus_queue.cc:1035] T c0ef481e23064506a5f423068aa9ddd8 P 21305fb26d5e4eaea9c89380a3659af7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ac3a013dd40ec9b807604646f811f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 07:05:12.882076 957 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 07:05:14.398841 32559 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:14.398947 32559 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:14.399693 32559 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75ddc55df9b446619149e0a5b5d9b703: Sending DeleteTablet for 3 replicas of tablet c0ef481e23064506a5f423068aa9ddd8
I20260808 07:05:14.399933 738 tablet_service.cc:1514] Processing DeleteTablet for tablet c0ef481e23064506a5f423068aa9ddd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:14 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:32840
I20260808 07:05:14.399938 301 tablet_service.cc:1514] Processing DeleteTablet for tablet c0ef481e23064506a5f423068aa9ddd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:14 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:34810
I20260808 07:05:14.400072 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 32670
I20260808 07:05:14.400111 515 tablet_service.cc:1514] Processing DeleteTablet for tablet c0ef481e23064506a5f423068aa9ddd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:14 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:38964
I20260808 07:05:14.406538 1080 tablet_replica.cc:330] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a: stopping tablet replica
I20260808 07:05:14.406615 1080 raft_consensus.cc:2229] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:14.406647 1080 raft_consensus.cc:2258] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:14.407478 1080 ts_tablet_manager.cc:1905] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:14.407502 1079 tablet_replica.cc:330] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f: stopping tablet replica
I20260808 07:05:14.407584 1079 raft_consensus.cc:2229] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:14.407634 1079 raft_consensus.cc:2258] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:14.407855 1079 ts_tablet_manager.cc:1905] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:14.409255 1080 ts_tablet_manager.cc:1918] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:05:14.409292 1079 ts_tablet_manager.cc:1918] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:05:14.409319 1080 log.cc:1196] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/c0ef481e23064506a5f423068aa9ddd8
I20260808 07:05:14.409350 1079 log.cc:1196] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/c0ef481e23064506a5f423068aa9ddd8
I20260808 07:05:14.409555 1080 ts_tablet_manager.cc:1939] T c0ef481e23064506a5f423068aa9ddd8 P 072b97f76da746d8b20c9409b2bd5e7a: Deleting consensus metadata
I20260808 07:05:14.409590 1079 ts_tablet_manager.cc:1939] T c0ef481e23064506a5f423068aa9ddd8 P e28ac3a013dd40ec9b807604646f811f: Deleting consensus metadata
I20260808 07:05:14.409895 32541 catalog_manager.cc:4841] TS 072b97f76da746d8b20c9409b2bd5e7a (127.29.82.66:42007): tablet c0ef481e23064506a5f423068aa9ddd8 (table test-table [id=ef43eeef023b4b5f89537b72e1b64f4e]) successfully deleted
I20260808 07:05:14.409924 32544 catalog_manager.cc:4841] TS e28ac3a013dd40ec9b807604646f811f (127.29.82.67:40375): tablet c0ef481e23064506a5f423068aa9ddd8 (table test-table [id=ef43eeef023b4b5f89537b72e1b64f4e]) successfully deleted
W20260808 07:05:14.414348 32541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:39321 (error 108)
I20260808 07:05:14.414517 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 411
I20260808 07:05:14.417899 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:14.414774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:39321 (local address 127.0.0.1:34848)
0808 07:05:14.417793 (+ 3019us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:14.417852 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:39321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2989,"thread_start_us":61,"threads_started":1}
W20260808 07:05:14.418017 32541 catalog_manager.cc:4584] TS 21305fb26d5e4eaea9c89380a3659af7 (127.29.82.65:39321): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c0ef481e23064506a5f423068aa9ddd8: Network error: Client connection negotiation failed: client connection to 127.29.82.65:39321: connect: Connection refused (error 111)
I20260808 07:05:14.422411 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 627
I20260808 07:05:14.430542 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 32520
2026-08-08T07:05:14Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5773 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:14 dist-test-slave-rmhg krb5kdc[1092](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:14 dist-test-slave-rmhg krb5kdc[1092](info): set up 2 sockets
Aug 08 07:05:14 dist-test-slave-rmhg krb5kdc[1092](info): commencing operation
krb5kdc: starting...
W20260808 07:05:15.572043 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:05:15 dist-test-slave-rmhg krb5kdc[1092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:05:15.697732 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:37267
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:41099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:37267
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:15.781471 1112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:15.781710 1112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:15.781733 1112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:15.782935 1112 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:15.782981 1112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:15.782995 1112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:15.783006 1112 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:15.783026 1112 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:15.784595 1112 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:41099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:37267
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:37267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:15.784855 1112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:15.785090 1112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:15.790325 1125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:15.790416 1123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:15.790397 1120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:15.790565 1112 server_base.cc:1034] running on GCE node
I20260808 07:05:15.790825 1112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:15.791141 1112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:15.792301 1112 hybrid_clock.cc:648] HybridClock initialized: now 1786172715792285 us; error 35 us; skew 500 ppm
Aug 08 07:05:15 dist-test-slave-rmhg krb5kdc[1092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172715, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:15.794909 1112 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:05:15.795339 1112 webserver.cc:460] Webserver started at http://127.29.82.126:41809/ using document root <none> and password file <none>
I20260808 07:05:15.795535 1112 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:15.795578 1112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:15.795672 1112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:15.796736 1112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "5acd7f39193b4c78b5766055e33d1f33"
format_stamp: "Formatted at 2026-08-08 07:05:15 on dist-test-slave-rmhg"
server_key: "9e70142f7016bc840a324a590f2c2f32"
server_key_iv: "5a0979a37b633d6a21d5dc53f1049a5e"
server_key_version: "encryptionkey@0"
I20260808 07:05:15.797068 1112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "5acd7f39193b4c78b5766055e33d1f33"
format_stamp: "Formatted at 2026-08-08 07:05:15 on dist-test-slave-rmhg"
server_key: "9e70142f7016bc840a324a590f2c2f32"
server_key_iv: "5a0979a37b633d6a21d5dc53f1049a5e"
server_key_version: "encryptionkey@0"
I20260808 07:05:15.798471 1112 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:15.799285 1136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:15.799484 1112 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:15.799584 1112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "5acd7f39193b4c78b5766055e33d1f33"
format_stamp: "Formatted at 2026-08-08 07:05:15 on dist-test-slave-rmhg"
server_key: "9e70142f7016bc840a324a590f2c2f32"
server_key_iv: "5a0979a37b633d6a21d5dc53f1049a5e"
server_key_version: "encryptionkey@0"
I20260808 07:05:15.799646 1112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:15.808943 1112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:15.811190 1112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:15.811311 1112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:15.815480 1112 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:37267
I20260808 07:05:15.815510 1216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:37267 every 8 connection(s)
I20260808 07:05:15.815922 1112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:15.816787 1218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:15.819146 1218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33: Bootstrap starting.
I20260808 07:05:15.819715 1218 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:15.819980 1218 log.cc:824] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:15.820653 1218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33: No bootstrap required, opened a new log
I20260808 07:05:15.822311 1218 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5acd7f39193b4c78b5766055e33d1f33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 37267 } }
I20260808 07:05:15.822465 1218 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:15.822505 1218 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5acd7f39193b4c78b5766055e33d1f33, State: Initialized, Role: FOLLOWER
I20260808 07:05:15.822633 1218 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5acd7f39193b4c78b5766055e33d1f33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 37267 } }
I20260808 07:05:15.822695 1218 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:15.822727 1218 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:15.822777 1218 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:15.823319 1218 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5acd7f39193b4c78b5766055e33d1f33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 37267 } }
I20260808 07:05:15.823375 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 1112
I20260808 07:05:15.823418 1218 leader_election.cc:302] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5acd7f39193b4c78b5766055e33d1f33; no voters:
I20260808 07:05:15.823462 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:15.823578 1218 leader_election.cc:288] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:15.823616 30025 external_mini_cluster.cc:1428] Setting key b45a3e055a3c96ae2018607325060518
I20260808 07:05:15.823622 1222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:15.823860 1218 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:15.824337 1222 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [term 1 LEADER]: Becoming Leader. State: Replica: 5acd7f39193b4c78b5766055e33d1f33, State: Running, Role: LEADER
I20260808 07:05:15.824466 1222 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5acd7f39193b4c78b5766055e33d1f33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 37267 } }
I20260808 07:05:15.824939 1222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5acd7f39193b4c78b5766055e33d1f33. Latest consensus state: current_term: 1 leader_uuid: "5acd7f39193b4c78b5766055e33d1f33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5acd7f39193b4c78b5766055e33d1f33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 37267 } } }
I20260808 07:05:15.825058 1222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:15.825047 1224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5acd7f39193b4c78b5766055e33d1f33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5acd7f39193b4c78b5766055e33d1f33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 37267 } } }
I20260808 07:05:15.826225 1224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33 [sys.catalog]: This master's current role is: LEADER
W20260808 07:05:15.826785 1256 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:05:15.826831 1256 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:05:15.827730 1257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:15.827943 1257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:15.830719 1257 catalog_manager.cc:1347] Generated new cluster ID: 6c3c09d9512a459496336140b21cda5c
I20260808 07:05:15.830775 1257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:05:15 dist-test-slave-rmhg krb5kdc[1092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:15.834578 1228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:15.824136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60822 (local address 127.29.82.126:37267)
0808 07:05:15.824376 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:15.824387 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:15.824495 (+ 108us) server_negotiation.cc:407] Connection header received
0808 07:05:15.824626 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:15.824634 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:15.824688 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:15.824815 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:15.826095 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:15.827408 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:15.828323 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:15.828847 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:15.828956 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:15.831623 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:15.831626 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:15.831626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:15.831637 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:15.833179 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:15.833508 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:15.833511 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:15.833512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:15.833610 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:15.833787 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:15.833788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:15.833789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:15.834027 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:15.834174 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:15.834273 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 07:05:15.834411 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":102,"threads_started":1}
I20260808 07:05:15.855216 1257 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:15.855922 1257 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:15.863040 1257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5acd7f39193b4c78b5766055e33d1f33: Generated new TSK 0
I20260808 07:05:15.863245 1257 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:05:15.894297 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:37267
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:41099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:15.983969 1267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:15.984184 1267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:15.984207 1267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:15.985379 1267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:15.985427 1267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:15.985453 1267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:05:15.986874 1267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:41099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:37267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:15.987068 1267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:15.987260 1267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:15.992225 1277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:15.992357 1267 server_base.cc:1034] running on GCE node
W20260808 07:05:15.992265 1276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:15.992480 1279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:15.992694 1267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:15.992918 1267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:15.994083 1267 hybrid_clock.cc:648] HybridClock initialized: now 1786172715994074 us; error 40 us; skew 500 ppm
Aug 08 07:05:15 dist-test-slave-rmhg krb5kdc[1092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172715, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:15.996563 1267 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:05:15.996954 1267 webserver.cc:460] Webserver started at http://127.29.82.65:37847/ using document root <none> and password file <none>
I20260808 07:05:15.997139 1267 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:15.997218 1267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:15.997324 1267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:15.998330 1267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "9061a9952e70449fb925cae2a1ea9d67"
format_stamp: "Formatted at 2026-08-08 07:05:15 on dist-test-slave-rmhg"
server_key: "ba27abdfd24175ea46957b2f17fd5c90"
server_key_iv: "c1db7f0de8012a0012c923084025f2ea"
server_key_version: "encryptionkey@0"
I20260808 07:05:15.998626 1267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "9061a9952e70449fb925cae2a1ea9d67"
format_stamp: "Formatted at 2026-08-08 07:05:15 on dist-test-slave-rmhg"
server_key: "ba27abdfd24175ea46957b2f17fd5c90"
server_key_iv: "c1db7f0de8012a0012c923084025f2ea"
server_key_version: "encryptionkey@0"
I20260808 07:05:15.999805 1267 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:05:16.000515 1289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:16.000656 1267 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:16.000741 1267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "9061a9952e70449fb925cae2a1ea9d67"
format_stamp: "Formatted at 2026-08-08 07:05:15 on dist-test-slave-rmhg"
server_key: "ba27abdfd24175ea46957b2f17fd5c90"
server_key_iv: "c1db7f0de8012a0012c923084025f2ea"
server_key_version: "encryptionkey@0"
I20260808 07:05:16.000801 1267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:16.016043 1267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:16.018281 1267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:16.018426 1267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:16.018658 1267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:16.018957 1267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:16.018991 1267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:16.019021 1267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:16.019044 1267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:16.024726 1267 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:43413
I20260808 07:05:16.024771 1462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:43413 every 8 connection(s)
I20260808 07:05:16.025130 1267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:05:16 dist-test-slave-rmhg krb5kdc[1092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172715, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:16.033365 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 1267
I20260808 07:05:16.033458 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:16.033660 30025 external_mini_cluster.cc:1428] Setting key 900d81f5f86b5fc06cbf51053dd776ba
I20260808 07:05:16.036595 1228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:16.025869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:48331 (local address 127.29.82.126:37267)
0808 07:05:16.025934 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:16.025936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:16.026131 (+ 195us) server_negotiation.cc:407] Connection header received
0808 07:05:16.026633 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:16.026634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:16.026645 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:16.026683 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:16.027974 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:16.028695 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:16.030245 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:16.030562 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:16.030642 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:16.033519 (+ 2877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:16.033521 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:16.033521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:16.033533 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:16.035134 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:16.035609 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:16.035610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:16.035611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:16.035698 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:16.035927 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:16.035928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:16.035928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:16.036065 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:16.036131 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:16.036400 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 07:05:16.036511 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 07:05:16.036823 1469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:16.025830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:37267 (local address 127.29.82.65:48331)
0808 07:05:16.025997 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:16.026041 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:16.026532 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:16.026782 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:16.026787 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:16.027570 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:16.027871 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:16.027880 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:16.028798 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:16.028799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:16.030142 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:16.030147 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:16.030727 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:16.030729 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:16.030894 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:16.031569 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:16.031581 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:16.033386 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:16.035217 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:16.035225 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:16.035228 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:16.035540 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:16.035760 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:16.035761 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:16.035761 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:16.035871 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:16.036125 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:16.036130 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:16.036256 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 07:05:16.036370 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 07:05:16.036587 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
I20260808 07:05:16.037345 1465 heartbeater.cc:347] Connected to a master server at 127.29.82.126:37267
I20260808 07:05:16.037451 1465 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:16.037647 1465 heartbeater.cc:511] Master 127.29.82.126:37267 requested a full tablet report, sending...
I20260808 07:05:16.038183 1160 ts_manager.cc:194] Registered new tserver with Master: 9061a9952e70449fb925cae2a1ea9d67 (127.29.82.65:43413)
I20260808 07:05:16.038776 1160 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:48331
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:05:16.059458 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:37267
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:41099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:16.142376 1473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:16.142583 1473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:16.142607 1473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:16.143802 1473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:16.143848 1473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:16.143873 1473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:05:16.145380 1473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:41099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:37267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:16.145608 1473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:16.145825 1473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:16.150727 1485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:16.150785 1480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:16.150730 1482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:16.150888 1473 server_base.cc:1034] running on GCE node
I20260808 07:05:16.151191 1473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:16.151422 1473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:16.152573 1473 hybrid_clock.cc:648] HybridClock initialized: now 1786172716152561 us; error 31 us; skew 500 ppm
Aug 08 07:05:16 dist-test-slave-rmhg krb5kdc[1092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172716, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:16.155073 1473 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:05:16.155548 1473 webserver.cc:460] Webserver started at http://127.29.82.66:33557/ using document root <none> and password file <none>
I20260808 07:05:16.155776 1473 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:16.155824 1473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:16.155962 1473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:16.157018 1473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "2adbe896b505476cb9284e6458ce9356"
format_stamp: "Formatted at 2026-08-08 07:05:16 on dist-test-slave-rmhg"
server_key: "803b6f21dce9d0133d789d07fa0e9a9d"
server_key_iv: "bc6032fbaa6f0157ab4f436311839968"
server_key_version: "encryptionkey@0"
I20260808 07:05:16.157384 1473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "2adbe896b505476cb9284e6458ce9356"
format_stamp: "Formatted at 2026-08-08 07:05:16 on dist-test-slave-rmhg"
server_key: "803b6f21dce9d0133d789d07fa0e9a9d"
server_key_iv: "bc6032fbaa6f0157ab4f436311839968"
server_key_version: "encryptionkey@0"
I20260808 07:05:16.158702 1473 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:16.159444 1494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:16.159601 1473 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:16.159696 1473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "2adbe896b505476cb9284e6458ce9356"
format_stamp: "Formatted at 2026-08-08 07:05:16 on dist-test-slave-rmhg"
server_key: "803b6f21dce9d0133d789d07fa0e9a9d"
server_key_iv: "bc6032fbaa6f0157ab4f436311839968"
server_key_version: "encryptionkey@0"
I20260808 07:05:16.159765 1473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:16.176692 1473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:16.178612 1473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:16.178741 1473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:16.178982 1473 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:16.179304 1473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:16.179337 1473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:16.179365 1473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:16.179382 1473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:16.185074 1473 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:46155
I20260808 07:05:16.185123 1671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:46155 every 8 connection(s)
I20260808 07:05:16.185480 1473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:05:16 dist-test-slave-rmhg krb5kdc[1092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172716, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:16.194855 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 1473
I20260808 07:05:16.194890 1228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:16.186265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:54545 (local address 127.29.82.126:37267)
0808 07:05:16.186339 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:16.186341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:16.186537 (+ 196us) server_negotiation.cc:407] Connection header received
0808 07:05:16.187091 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:16.187092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:16.187107 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:16.187159 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:16.188130 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:16.188680 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:16.189760 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:16.189970 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:16.190026 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:16.192219 (+ 2193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:16.192221 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:16.192221 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:16.192229 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:16.193602 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:16.194015 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:16.194017 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:16.194017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:16.194080 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:16.194282 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:16.194282 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:16.194283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:16.194390 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:16.194438 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:16.194690 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 07:05:16.194791 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 07:05:16.194969 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:16.194988 1676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:16.186239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:37267 (local address 127.29.82.66:54545)
0808 07:05:16.186411 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:16.186448 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:16.186980 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:16.187234 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:16.187238 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:16.187796 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:16.188027 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:16.188033 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:16.188795 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:16.188796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:16.189671 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:16.189674 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:16.190035 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:16.190036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:16.190138 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:16.190673 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:16.190683 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:16.192127 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:16.193690 (+ 1563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:16.193697 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:16.193699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:16.193927 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:16.194140 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:16.194140 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:16.194141 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:16.194236 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:16.194433 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:16.194436 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:16.194556 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 07:05:16.194662 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 07:05:16.194792 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":88,"threads_started":1}
I20260808 07:05:16.195218 30025 external_mini_cluster.cc:1428] Setting key aa11450bf6c3fa391752b72dd024b0b7
I20260808 07:05:16.195627 1672 heartbeater.cc:347] Connected to a master server at 127.29.82.126:37267
I20260808 07:05:16.195744 1672 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:16.195943 1672 heartbeater.cc:511] Master 127.29.82.126:37267 requested a full tablet report, sending...
I20260808 07:05:16.196358 1160 ts_manager.cc:194] Registered new tserver with Master: 2adbe896b505476cb9284e6458ce9356 (127.29.82.66:46155)
I20260808 07:05:16.196728 1160 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:54545
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:05:16.219663 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:37267
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:41099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:16.301407 1682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:16.301620 1682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:16.301644 1682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:16.302835 1682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:16.302878 1682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:16.302904 1682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:05:16.304468 1682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:41099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:37267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:16.304721 1682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:16.304956 1682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:16.309934 1690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:16.309934 1697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:16.309952 1693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:16.310262 1682 server_base.cc:1034] running on GCE node
I20260808 07:05:16.310456 1682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:16.310701 1682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:16.311830 1682 hybrid_clock.cc:648] HybridClock initialized: now 1786172716311819 us; error 27 us; skew 500 ppm
Aug 08 07:05:16 dist-test-slave-rmhg krb5kdc[1092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172716, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:16.314327 1682 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:05:16.314793 1682 webserver.cc:460] Webserver started at http://127.29.82.67:44223/ using document root <none> and password file <none>
I20260808 07:05:16.315001 1682 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:16.315050 1682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:16.315181 1682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:16.316210 1682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "35ed0dfb42a940cc9600e143bc29019e"
format_stamp: "Formatted at 2026-08-08 07:05:16 on dist-test-slave-rmhg"
server_key: "92069fb13b8d0e24b76e2a39867dce8f"
server_key_iv: "c2a12eeabb2179c41096f408a1e8400c"
server_key_version: "encryptionkey@0"
I20260808 07:05:16.316542 1682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "35ed0dfb42a940cc9600e143bc29019e"
format_stamp: "Formatted at 2026-08-08 07:05:16 on dist-test-slave-rmhg"
server_key: "92069fb13b8d0e24b76e2a39867dce8f"
server_key_iv: "c2a12eeabb2179c41096f408a1e8400c"
server_key_version: "encryptionkey@0"
I20260808 07:05:16.317883 1682 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:16.318593 1707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:16.318766 1682 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:16.318852 1682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "35ed0dfb42a940cc9600e143bc29019e"
format_stamp: "Formatted at 2026-08-08 07:05:16 on dist-test-slave-rmhg"
server_key: "92069fb13b8d0e24b76e2a39867dce8f"
server_key_iv: "c2a12eeabb2179c41096f408a1e8400c"
server_key_version: "encryptionkey@0"
I20260808 07:05:16.318912 1682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:16.330327 1682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:16.332187 1682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:16.332329 1682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:16.332562 1682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:16.332872 1682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:16.332906 1682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:16.332935 1682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:16.332959 1682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:16.338707 1682 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:42425
I20260808 07:05:16.338748 1879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:42425 every 8 connection(s)
I20260808 07:05:16.339066 1682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:05:16 dist-test-slave-rmhg krb5kdc[1092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172716, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:16.345008 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 1682
I20260808 07:05:16.345103 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:16.345331 30025 external_mini_cluster.cc:1428] Setting key b82cb59b11a7240e9d440013ac57e4a5
I20260808 07:05:16.348088 1228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:16.339764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:48279 (local address 127.29.82.126:37267)
0808 07:05:16.339829 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:16.339831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:16.340084 (+ 253us) server_negotiation.cc:407] Connection header received
0808 07:05:16.340550 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:16.340551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:16.340562 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:16.340614 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:16.341609 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:16.342109 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:16.343088 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:16.343260 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:16.343302 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:16.345548 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:16.345550 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:16.345551 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:16.345561 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:16.346977 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:16.347357 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:16.347358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:16.347358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:16.347410 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:16.347583 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:16.347583 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:16.347583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:16.347684 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:16.347728 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:16.347948 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 07:05:16.348020 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:05:16.348265 1884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:16.339742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:37267 (local address 127.29.82.67:48279)
0808 07:05:16.339956 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:16.339996 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:16.340473 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:16.340685 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:16.340689 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:16.341319 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:16.341531 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:16.341536 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:16.342186 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:16.342187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:16.343018 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:16.343021 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:16.343312 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:16.343313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:16.343412 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:16.343906 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:16.343916 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:16.345443 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:16.347049 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:16.347055 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:16.347057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:16.347305 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:16.347450 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:16.347451 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:16.347451 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:16.347546 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:16.347725 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:16.347729 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:16.347847 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 07:05:16.347929 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 07:05:16.348062 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":83,"threads_started":1}
I20260808 07:05:16.348713 1880 heartbeater.cc:347] Connected to a master server at 127.29.82.126:37267
I20260808 07:05:16.348809 1880 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:16.348994 1880 heartbeater.cc:511] Master 127.29.82.126:37267 requested a full tablet report, sending...
I20260808 07:05:16.349385 1160 ts_manager.cc:194] Registered new tserver with Master: 35ed0dfb42a940cc9600e143bc29019e (127.29.82.67:42425)
I20260808 07:05:16.349752 1160 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:48279
I20260808 07:05:16.357228 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 07:05:16.370761 1228 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:05:16.369782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60836 (local address 127.29.82.126:37267)
0808 07:05:16.369846 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:16.369848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:16.369955 (+ 107us) server_negotiation.cc:407] Connection header received
0808 07:05:16.370048 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:16.370049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:16.370059 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:16.370101 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:16.370684 (+ 583us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60836: BlockingRecv error: recv got EOF from 127.0.0.1:60836 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:05:16.371547 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 1267
I20260808 07:05:16.386287 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 1473
I20260808 07:05:16.406095 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 1682
I20260808 07:05:16.417635 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 1112
2026-08-08T07:05:16Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1985 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:16 dist-test-slave-rmhg krb5kdc[1902](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:16 dist-test-slave-rmhg krb5kdc[1902](info): set up 2 sockets
Aug 08 07:05:16 dist-test-slave-rmhg krb5kdc[1902](info): commencing operation
krb5kdc: starting...
W20260808 07:05:17.546387 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:05:17 dist-test-slave-rmhg krb5kdc[1902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:05:17.671435 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:44405
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:43551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:44405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:17.755473 1923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:17.755695 1923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:17.755717 1923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:17.756870 1923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:17.756912 1923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:17.756925 1923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:17.756937 1923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:17.756947 1923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:17.758494 1923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:43551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:44405
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:44405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:17.758731 1923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:17.758951 1923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:17.763687 1931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:17.763698 1932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:17.763684 1936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:17.763978 1923 server_base.cc:1034] running on GCE node
I20260808 07:05:17.764216 1923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:17.764509 1923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:17.765646 1923 hybrid_clock.cc:648] HybridClock initialized: now 1786172717765630 us; error 36 us; skew 500 ppm
Aug 08 07:05:17 dist-test-slave-rmhg krb5kdc[1902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172717, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:17.768107 1923 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:05:17.768507 1923 webserver.cc:460] Webserver started at http://127.29.82.126:46165/ using document root <none> and password file <none>
I20260808 07:05:17.768738 1923 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:17.768783 1923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:17.768905 1923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:17.770015 1923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "e0efbd337cef4da7b17e7ac4457ef663"
format_stamp: "Formatted at 2026-08-08 07:05:17 on dist-test-slave-rmhg"
server_key: "caeae3d8a2f2d6a93e3b7dd2ed6c0fb7"
server_key_iv: "2cca817603b470f1f9002a8818a678ef"
server_key_version: "encryptionkey@0"
I20260808 07:05:17.770385 1923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "e0efbd337cef4da7b17e7ac4457ef663"
format_stamp: "Formatted at 2026-08-08 07:05:17 on dist-test-slave-rmhg"
server_key: "caeae3d8a2f2d6a93e3b7dd2ed6c0fb7"
server_key_iv: "2cca817603b470f1f9002a8818a678ef"
server_key_version: "encryptionkey@0"
I20260808 07:05:17.771802 1923 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:05:17.772504 1943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:17.772668 1923 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:17.772753 1923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "e0efbd337cef4da7b17e7ac4457ef663"
format_stamp: "Formatted at 2026-08-08 07:05:17 on dist-test-slave-rmhg"
server_key: "caeae3d8a2f2d6a93e3b7dd2ed6c0fb7"
server_key_iv: "2cca817603b470f1f9002a8818a678ef"
server_key_version: "encryptionkey@0"
I20260808 07:05:17.772825 1923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:17.785297 1923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:17.787189 1923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:17.787315 1923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:17.791077 1923 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:44405
I20260808 07:05:17.791146 2010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:44405 every 8 connection(s)
I20260808 07:05:17.791581 1923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:17.792253 2011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:17.794682 2011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663: Bootstrap starting.
I20260808 07:05:17.795271 2011 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:17.795552 2011 log.cc:824] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:17.796238 2011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663: No bootstrap required, opened a new log
I20260808 07:05:17.797348 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 1923
I20260808 07:05:17.797452 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:17.797631 30025 external_mini_cluster.cc:1428] Setting key e0c0c9f288d8fc83141157f8c746259d
I20260808 07:05:17.798211 2011 raft_consensus.cc:348] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0efbd337cef4da7b17e7ac4457ef663" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44405 } }
I20260808 07:05:17.798354 2011 raft_consensus.cc:374] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:17.798377 2011 raft_consensus.cc:729] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0efbd337cef4da7b17e7ac4457ef663, State: Initialized, Role: FOLLOWER
I20260808 07:05:17.798522 2011 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0efbd337cef4da7b17e7ac4457ef663" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44405 } }
I20260808 07:05:17.798583 2011 raft_consensus.cc:388] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:17.798616 2011 raft_consensus.cc:482] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:17.798662 2011 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:17.799244 2011 raft_consensus.cc:504] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0efbd337cef4da7b17e7ac4457ef663" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44405 } }
I20260808 07:05:17.799360 2011 leader_election.cc:302] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0efbd337cef4da7b17e7ac4457ef663; no voters:
I20260808 07:05:17.799539 2011 leader_election.cc:288] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:17.799575 2020 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:17.799739 2020 raft_consensus.cc:686] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [term 1 LEADER]: Becoming Leader. State: Replica: e0efbd337cef4da7b17e7ac4457ef663, State: Running, Role: LEADER
I20260808 07:05:17.799822 2011 sys_catalog.cc:564] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:17.799875 2020 consensus_queue.cc:237] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0efbd337cef4da7b17e7ac4457ef663" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44405 } }
I20260808 07:05:17.800231 2020 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0efbd337cef4da7b17e7ac4457ef663. Latest consensus state: current_term: 1 leader_uuid: "e0efbd337cef4da7b17e7ac4457ef663" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0efbd337cef4da7b17e7ac4457ef663" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44405 } } }
I20260808 07:05:17.800472 2020 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:17.800396 2022 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e0efbd337cef4da7b17e7ac4457ef663" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0efbd337cef4da7b17e7ac4457ef663" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44405 } } }
I20260808 07:05:17.800900 2031 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:17.800901 2022 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:17.801604 2031 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:17.803355 2031 catalog_manager.cc:1347] Generated new cluster ID: 024bd381a0ad4eb8ad57ff4c2f03e634
I20260808 07:05:17.803452 2031 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:05:17 dist-test-slave-rmhg krb5kdc[1902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:17.808775 2016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:17.798179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40724 (local address 127.29.82.126:44405)
0808 07:05:17.798798 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:17.798808 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:17.798834 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:05:17.798943 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:17.798948 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:17.798991 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:17.799112 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:17.800105 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:17.801591 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:17.802313 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:17.802909 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:17.803038 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:17.805363 (+ 2325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:17.805366 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:17.805366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:17.805377 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:17.806977 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:17.807300 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:17.807303 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:17.807304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:17.807787 (+ 483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:17.807981 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:17.807982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:17.807983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:17.808222 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:17.808394 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:17.808468 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 07:05:17.808621 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":529,"threads_started":1}
I20260808 07:05:17.809626 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:17.828711 2031 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:17.829425 2031 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:17.831028 2016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:17.826747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40730 (local address 127.29.82.126:44405)
0808 07:05:17.826793 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:17.826795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:17.826947 (+ 152us) server_negotiation.cc:407] Connection header received
0808 07:05:17.827005 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:17.827006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:17.827018 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:17.827082 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:17.827507 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:17.828283 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:17.829341 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:17.829672 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:17.829742 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:17.830515 (+ 773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:17.830516 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:17.830517 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:17.830755 (+ 238us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:17.830775 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:17.830784 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:17.830840 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:17.830897 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 07:05:17.830946 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:05:17.834658 2031 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e0efbd337cef4da7b17e7ac4457ef663: Generated new TSK 0
I20260808 07:05:17.834865 2031 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:17.839788 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 1923
2026-08-08T07:05:17Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1427 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:17 dist-test-slave-rmhg krb5kdc[2060](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:17 dist-test-slave-rmhg krb5kdc[2060](info): set up 2 sockets
Aug 08 07:05:17 dist-test-slave-rmhg krb5kdc[2060](info): commencing operation
krb5kdc: starting...
W20260808 07:05:18.973193 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:05:19 dist-test-slave-rmhg krb5kdc[2060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:05:19.093307 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:40127
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:33283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:40127
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:19.175011 2084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:19.175220 2084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:19.175239 2084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:19.176303 2084 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:19.176337 2084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:19.176349 2084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:19.176360 2084 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:19.176370 2084 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:19.177790 2084 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:33283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:40127
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:40127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:19.177984 2084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:19.178197 2084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:19.182895 2095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:19.182909 2092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:19.182909 2091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:19.183053 2084 server_base.cc:1034] running on GCE node
I20260808 07:05:19.183398 2084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:19.183692 2084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:19.184856 2084 hybrid_clock.cc:648] HybridClock initialized: now 1786172719184844 us; error 43 us; skew 500 ppm
Aug 08 07:05:19 dist-test-slave-rmhg krb5kdc[2060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:19.187395 2084 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:05:19.187881 2084 webserver.cc:460] Webserver started at http://127.29.82.126:39293/ using document root <none> and password file <none>
I20260808 07:05:19.188089 2084 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:19.188138 2084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:19.188261 2084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:19.189361 2084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "a874ee80adbf4157a89a97e834221195"
format_stamp: "Formatted at 2026-08-08 07:05:19 on dist-test-slave-rmhg"
server_key: "4db614648f486cada8c6677d2b91d6a2"
server_key_iv: "5a251409b681637946e7846823addcad"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.189697 2084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "a874ee80adbf4157a89a97e834221195"
format_stamp: "Formatted at 2026-08-08 07:05:19 on dist-test-slave-rmhg"
server_key: "4db614648f486cada8c6677d2b91d6a2"
server_key_iv: "5a251409b681637946e7846823addcad"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.190924 2084 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:19.191630 2105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.191778 2084 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:19.191866 2084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "a874ee80adbf4157a89a97e834221195"
format_stamp: "Formatted at 2026-08-08 07:05:19 on dist-test-slave-rmhg"
server_key: "4db614648f486cada8c6677d2b91d6a2"
server_key_iv: "5a251409b681637946e7846823addcad"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.191923 2084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:19.203588 2084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:19.205564 2084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:19.205703 2084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:19.209646 2084 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:40127
I20260808 07:05:19.209682 2180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:40127 every 8 connection(s)
I20260808 07:05:19.210021 2084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:19.210992 2182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:19.213341 2182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195: Bootstrap starting.
I20260808 07:05:19.213884 2182 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:19.214124 2182 log.cc:824] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:19.214793 2182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195: No bootstrap required, opened a new log
I20260808 07:05:19.216439 2182 raft_consensus.cc:348] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a874ee80adbf4157a89a97e834221195" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 40127 } }
I20260808 07:05:19.216581 2182 raft_consensus.cc:374] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:19.216603 2182 raft_consensus.cc:729] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a874ee80adbf4157a89a97e834221195, State: Initialized, Role: FOLLOWER
I20260808 07:05:19.216714 2182 consensus_queue.cc:260] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a874ee80adbf4157a89a97e834221195" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 40127 } }
I20260808 07:05:19.216765 2182 raft_consensus.cc:388] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:19.216789 2182 raft_consensus.cc:482] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:19.216817 2182 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:19.217638 2182 raft_consensus.cc:504] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a874ee80adbf4157a89a97e834221195" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 40127 } }
I20260808 07:05:19.217731 2182 leader_election.cc:302] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a874ee80adbf4157a89a97e834221195; no voters:
I20260808 07:05:19.217857 2182 leader_election.cc:288] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:19.217926 2188 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:19.218106 2188 raft_consensus.cc:686] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [term 1 LEADER]: Becoming Leader. State: Replica: a874ee80adbf4157a89a97e834221195, State: Running, Role: LEADER
I20260808 07:05:19.218142 2182 sys_catalog.cc:564] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:19.218263 2188 consensus_queue.cc:237] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a874ee80adbf4157a89a97e834221195" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 40127 } }
I20260808 07:05:19.218686 2196 sys_catalog.cc:455] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a874ee80adbf4157a89a97e834221195. Latest consensus state: current_term: 1 leader_uuid: "a874ee80adbf4157a89a97e834221195" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a874ee80adbf4157a89a97e834221195" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 40127 } } }
I20260808 07:05:19.218724 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 2084
I20260808 07:05:19.218773 2196 sys_catalog.cc:458] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:19.218824 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:19.218932 2194 sys_catalog.cc:455] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a874ee80adbf4157a89a97e834221195" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a874ee80adbf4157a89a97e834221195" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 40127 } } }
I20260808 07:05:19.218977 2194 sys_catalog.cc:458] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:19.219019 30025 external_mini_cluster.cc:1428] Setting key 679c3e4ea562468782ec4d5701bbfc88
I20260808 07:05:19.219791 2206 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:19.220283 2206 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:19.221917 2206 catalog_manager.cc:1347] Generated new cluster ID: 9e8b7a4dfdd04f3b869d4a5a1fc28e2a
I20260808 07:05:19.221971 2206 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:05:19 dist-test-slave-rmhg krb5kdc[2060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:19.228781 2218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.219485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58396 (local address 127.29.82.126:40127)
0808 07:05:19.219702 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:19.219713 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:19.219747 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:05:19.219874 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:19.219882 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:19.219940 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:19.220062 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:19.220787 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.222200 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.222947 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.223394 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.223490 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:19.225766 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:19.225770 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:19.225770 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:19.225783 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:19.227325 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:19.227652 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:19.227654 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:19.227655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:19.227755 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:19.227934 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:19.227935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:19.227935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:19.228177 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:19.228338 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:19.228436 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 07:05:19.228575 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":73,"threads_started":1}
I20260808 07:05:19.243124 2206 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:19.243659 2206 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:19.246483 2206 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a874ee80adbf4157a89a97e834221195: Generated new TSK 0
I20260808 07:05:19.246671 2206 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:05:19.282068 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:40127
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:33283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:19.390529 2224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:19.390802 2224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:19.390839 2224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:19.392144 2224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:19.392189 2224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:19.392223 2224 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:05:19.393877 2224 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:33283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:40127
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:19.394637 2224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:19.396195 2224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:19.401450 2230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:19.401542 2224 server_base.cc:1034] running on GCE node
W20260808 07:05:19.401593 2233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:19.401422 2231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:19.402014 2224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:19.402274 2224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:19.403469 2224 hybrid_clock.cc:648] HybridClock initialized: now 1786172719403454 us; error 31 us; skew 500 ppm
Aug 08 07:05:19 dist-test-slave-rmhg krb5kdc[2060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:19.407819 2224 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:05:19.408329 2224 webserver.cc:460] Webserver started at http://127.29.82.65:39455/ using document root <none> and password file <none>
I20260808 07:05:19.408564 2224 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:19.408619 2224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:19.408752 2224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:19.409871 2224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "1626b6440a4349a882a59f849cee71a9"
format_stamp: "Formatted at 2026-08-08 07:05:19 on dist-test-slave-rmhg"
server_key: "4334b258d85d124692073e96cffbbfe6"
server_key_iv: "10df84b43e3cc4ded906b0d90196233c"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.410210 2224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "1626b6440a4349a882a59f849cee71a9"
format_stamp: "Formatted at 2026-08-08 07:05:19 on dist-test-slave-rmhg"
server_key: "4334b258d85d124692073e96cffbbfe6"
server_key_iv: "10df84b43e3cc4ded906b0d90196233c"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.411458 2224 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:19.412238 2246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.412411 2224 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:19.412498 2224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "1626b6440a4349a882a59f849cee71a9"
format_stamp: "Formatted at 2026-08-08 07:05:19 on dist-test-slave-rmhg"
server_key: "4334b258d85d124692073e96cffbbfe6"
server_key_iv: "10df84b43e3cc4ded906b0d90196233c"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.412567 2224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:19.430107 2224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:19.432358 2224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:19.432504 2224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:19.432756 2224 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:19.433073 2224 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:19.433107 2224 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.433137 2224 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:19.433176 2224 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.438884 2224 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:42757
I20260808 07:05:19.438938 2411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:42757 every 8 connection(s)
I20260808 07:05:19.439242 2224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:05:19 dist-test-slave-rmhg krb5kdc[2060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:19.448467 2218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.439975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:52889 (local address 127.29.82.126:40127)
0808 07:05:19.440026 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:19.440028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:19.440292 (+ 264us) server_negotiation.cc:407] Connection header received
0808 07:05:19.440750 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:19.440751 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:19.440766 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:19.440828 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:19.441878 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.442392 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.443427 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.443625 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.443676 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:19.445986 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:19.445988 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:19.445988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:19.445996 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:19.447375 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:19.447741 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:19.447742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:19.447742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:19.447794 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:19.447972 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:19.447972 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:19.447972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:19.448073 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:19.448118 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:19.448331 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 07:05:19.448396 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:05:19.448686 2415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.439946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:40127 (local address 127.29.82.65:52889)
0808 07:05:19.440131 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:19.440174 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:19.440670 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:19.440917 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:19.440921 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:19.441560 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:19.441771 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:19.441776 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.442499 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.442500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:19.443355 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:19.443358 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.443728 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.443729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:19.443860 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:19.444379 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:19.444388 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:19.445866 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:19.447449 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:19.447455 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:19.447458 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:19.447679 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:19.447839 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:19.447839 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:19.447839 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:19.447931 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:19.448113 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:19.448116 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:19.448235 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 07:05:19.448311 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 07:05:19.448438 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":87,"threads_started":1}
I20260808 07:05:19.448729 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 2224
I20260808 07:05:19.448818 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:19.449014 30025 external_mini_cluster.cc:1428] Setting key 691e9872f277386cb82d14bce5d195cc
I20260808 07:05:19.449257 2412 heartbeater.cc:347] Connected to a master server at 127.29.82.126:40127
I20260808 07:05:19.449368 2412 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:19.449568 2412 heartbeater.cc:511] Master 127.29.82.126:40127 requested a full tablet report, sending...
I20260808 07:05:19.450219 2127 ts_manager.cc:194] Registered new tserver with Master: 1626b6440a4349a882a59f849cee71a9 (127.29.82.65:42757)
I20260808 07:05:19.450995 2127 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:52889
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:05:19.475631 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:40127
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:33283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:19.557932 2419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:19.558175 2419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:19.558210 2419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:19.559412 2419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:19.559459 2419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:19.559494 2419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:05:19.561023 2419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:33283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:40127
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:19.561295 2419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:19.561535 2419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:19.566526 2431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:19.566533 2428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:19.566610 2426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:19.566804 2419 server_base.cc:1034] running on GCE node
I20260808 07:05:19.566999 2419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:19.567219 2419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:19.568390 2419 hybrid_clock.cc:648] HybridClock initialized: now 1786172719568372 us; error 30 us; skew 500 ppm
Aug 08 07:05:19 dist-test-slave-rmhg krb5kdc[2060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:19.573695 2419 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:05:19.574162 2419 webserver.cc:460] Webserver started at http://127.29.82.66:46815/ using document root <none> and password file <none>
I20260808 07:05:19.574390 2419 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:19.574442 2419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:19.574579 2419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:19.575656 2419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "c8711578d43d460694e322e4db8f03e6"
format_stamp: "Formatted at 2026-08-08 07:05:19 on dist-test-slave-rmhg"
server_key: "0cee5245c2005bf79568f91e0e2052ed"
server_key_iv: "0c4dee83e64cca66b9336b05c5c1501c"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.575999 2419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "c8711578d43d460694e322e4db8f03e6"
format_stamp: "Formatted at 2026-08-08 07:05:19 on dist-test-slave-rmhg"
server_key: "0cee5245c2005bf79568f91e0e2052ed"
server_key_iv: "0c4dee83e64cca66b9336b05c5c1501c"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.577448 2419 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:05:19.578285 2448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.578457 2419 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:19.578583 2419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "c8711578d43d460694e322e4db8f03e6"
format_stamp: "Formatted at 2026-08-08 07:05:19 on dist-test-slave-rmhg"
server_key: "0cee5245c2005bf79568f91e0e2052ed"
server_key_iv: "0c4dee83e64cca66b9336b05c5c1501c"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.578650 2419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:19.592507 2419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:19.594578 2419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:19.594717 2419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:19.594940 2419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:19.595265 2419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:19.595306 2419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.595335 2419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:19.595358 2419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.601044 2419 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:37105
I20260808 07:05:19.601086 2620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:37105 every 8 connection(s)
I20260808 07:05:19.601485 2419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:05:19 dist-test-slave-rmhg krb5kdc[2060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:19.610673 2218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.602341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:50185 (local address 127.29.82.126:40127)
0808 07:05:19.602426 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:19.602428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:19.602587 (+ 159us) server_negotiation.cc:407] Connection header received
0808 07:05:19.603104 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:19.603105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:19.603118 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:19.603170 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:19.604167 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.604678 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.605739 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.605937 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.606002 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:19.608089 (+ 2087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:19.608091 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:19.608091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:19.608100 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:19.609386 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:19.609767 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:19.609768 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:19.609769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:19.609827 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:19.610051 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:19.610052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:19.610053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:19.610172 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:19.610228 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:19.610487 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 07:05:19.610578 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 07:05:19.610854 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.602241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:40127 (local address 127.29.82.66:50185)
0808 07:05:19.602463 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:19.602504 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:19.603008 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:19.603246 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:19.603250 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:19.603857 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:19.604069 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:19.604074 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.604764 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.604765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:19.605658 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:19.605660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.606014 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.606015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:19.606138 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:19.606660 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:19.606670 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:19.607998 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:19.609468 (+ 1470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:19.609475 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:19.609477 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:19.609698 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:19.609882 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:19.609883 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:19.609883 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:19.609987 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:19.610228 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:19.610236 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:19.610368 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 07:05:19.610457 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 07:05:19.610630 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":100,"threads_started":1}
I20260808 07:05:19.611389 2623 heartbeater.cc:347] Connected to a master server at 127.29.82.126:40127
I20260808 07:05:19.611400 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 2419
I20260808 07:05:19.611479 2623 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:19.611505 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:19.611665 2623 heartbeater.cc:511] Master 127.29.82.126:40127 requested a full tablet report, sending...
I20260808 07:05:19.611688 30025 external_mini_cluster.cc:1428] Setting key 26c4786fe82a71ddbf42d334240a78c7
I20260808 07:05:19.612066 2125 ts_manager.cc:194] Registered new tserver with Master: c8711578d43d460694e322e4db8f03e6 (127.29.82.66:37105)
I20260808 07:05:19.612468 2125 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:50185
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:05:19.637962 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:40127
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:33283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:19.722637 2630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:19.722841 2630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:19.722863 2630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:19.724022 2630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:19.724069 2630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:19.724094 2630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:05:19.725677 2630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:33283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:40127
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:19.725924 2630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:19.726163 2630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:19.731186 2640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:19.731196 2642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:19.731333 2630 server_base.cc:1034] running on GCE node
W20260808 07:05:19.731204 2644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:19.731660 2630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:19.731894 2630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:19.733033 2630 hybrid_clock.cc:648] HybridClock initialized: now 1786172719733011 us; error 39 us; skew 500 ppm
Aug 08 07:05:19 dist-test-slave-rmhg krb5kdc[2060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:19.735639 2630 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:05:19.736080 2630 webserver.cc:460] Webserver started at http://127.29.82.67:44723/ using document root <none> and password file <none>
I20260808 07:05:19.736322 2630 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:19.736370 2630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:19.736482 2630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:19.737627 2630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "2546b9cf06894415b6004d36b02c28a2"
format_stamp: "Formatted at 2026-08-08 07:05:19 on dist-test-slave-rmhg"
server_key: "e2a1f0651559a52c5979caeeefd6e0b8"
server_key_iv: "95c35dee6396d4c5a1b648e359f98785"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.737958 2630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "2546b9cf06894415b6004d36b02c28a2"
format_stamp: "Formatted at 2026-08-08 07:05:19 on dist-test-slave-rmhg"
server_key: "e2a1f0651559a52c5979caeeefd6e0b8"
server_key_iv: "95c35dee6396d4c5a1b648e359f98785"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.739296 2630 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:19.740150 2655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.740324 2630 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:19.740422 2630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "2546b9cf06894415b6004d36b02c28a2"
format_stamp: "Formatted at 2026-08-08 07:05:19 on dist-test-slave-rmhg"
server_key: "e2a1f0651559a52c5979caeeefd6e0b8"
server_key_iv: "95c35dee6396d4c5a1b648e359f98785"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.740492 2630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:19.752730 2630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:19.755254 2630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:19.755385 2630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:19.755645 2630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:19.755977 2630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:19.756013 2630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.756035 2630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:19.756047 2630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.761675 2630 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:38507
I20260808 07:05:19.761726 2836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:38507 every 8 connection(s)
I20260808 07:05:19.762064 2630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:05:19.763478 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 2630
I20260808 07:05:19.763597 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:19.763803 30025 external_mini_cluster.cc:1428] Setting key c88bda4f3f738f067353e0c4c5fcca92
Aug 08 07:05:19 dist-test-slave-rmhg krb5kdc[2060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:19.771639 2218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.762813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:32981 (local address 127.29.82.126:40127)
0808 07:05:19.762859 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:19.762861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:19.763076 (+ 215us) server_negotiation.cc:407] Connection header received
0808 07:05:19.763606 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:19.763608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:19.763622 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:19.763700 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:19.764816 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.765399 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.766476 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.766688 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.766747 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:19.769124 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:19.769126 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:19.769126 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:19.769136 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:19.770461 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:19.770829 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:19.770829 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:19.770830 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:19.770876 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:19.771108 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:19.771109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:19.771109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:19.771208 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:19.771253 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:19.771475 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 07:05:19.771570 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:05:19.771800 2841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.762782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:40127 (local address 127.29.82.67:32981)
0808 07:05:19.762946 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:19.762988 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:19.763482 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:19.763768 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:19.763772 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:19.764488 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:19.764726 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:19.764733 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.765518 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.765520 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:19.766370 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:19.766372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.766796 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.766797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:19.766922 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:19.767460 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:19.767469 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:19.769016 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:19.770532 (+ 1516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:19.770538 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:19.770541 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:19.770770 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:19.770928 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:19.770929 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:19.770929 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:19.771063 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:19.771250 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:19.771253 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:19.771378 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 07:05:19.771457 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 07:05:19.771588 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260808 07:05:19.772281 2837 heartbeater.cc:347] Connected to a master server at 127.29.82.126:40127
I20260808 07:05:19.772380 2837 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:19.772574 2837 heartbeater.cc:511] Master 127.29.82.126:40127 requested a full tablet report, sending...
I20260808 07:05:19.772965 2125 ts_manager.cc:194] Registered new tserver with Master: 2546b9cf06894415b6004d36b02c28a2 (127.29.82.67:38507)
I20260808 07:05:19.773361 2125 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:32981
I20260808 07:05:19.775646 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:05:19 dist-test-slave-rmhg krb5kdc[2060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 07:05:19 dist-test-slave-rmhg krb5kdc[2060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:19.799304 2218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.792117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36764 (local address 127.29.82.126:40127)
0808 07:05:19.792190 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:19.792192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:19.792261 (+ 69us) server_negotiation.cc:407] Connection header received
0808 07:05:19.792337 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:19.792338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:19.792349 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:19.792397 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:19.793011 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.793574 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.794333 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:19.794534 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:19.794590 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:19.796884 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:19.796886 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:19.796886 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:19.796895 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:19.798197 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:19.798505 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:19.798506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:19.798506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:19.798561 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:19.798731 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:19.798731 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:19.798732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:19.798899 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:19.798988 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:19.799111 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 07:05:19.799205 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260808 07:05:19.799609 2125 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:36764
I20260808 07:05:19.800129 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 2224
I20260808 07:05:19.808753 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 2419
I20260808 07:05:19.822242 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 2630
I20260808 07:05:19.835054 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 2084
2026-08-08T07:05:19Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1993 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:19 dist-test-slave-rmhg krb5kdc[2857](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:19 dist-test-slave-rmhg krb5kdc[2857](info): set up 2 sockets
Aug 08 07:05:19 dist-test-slave-rmhg krb5kdc[2857](info): commencing operation
krb5kdc: starting...
W20260808 07:05:20.966758 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[2857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:05:21.093700 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:37561
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:37561
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:21.176903 2877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:21.177186 2877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:21.177209 2877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:21.178383 2877 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:21.178423 2877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:21.178437 2877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:21.178448 2877 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:21.178459 2877 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:21.179988 2877 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:37561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:37561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:21.180199 2877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:21.180385 2877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:21.185326 2888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:21.185326 2885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:21.185398 2877 server_base.cc:1034] running on GCE node
W20260808 07:05:21.185355 2883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:21.185838 2877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:21.186103 2877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:21.187255 2877 hybrid_clock.cc:648] HybridClock initialized: now 1786172721187234 us; error 37 us; skew 500 ppm
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[2857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172721, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:21.189750 2877 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:05:21.190203 2877 webserver.cc:460] Webserver started at http://127.29.82.126:34405/ using document root <none> and password file <none>
I20260808 07:05:21.190407 2877 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:21.190454 2877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:21.190579 2877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:21.191645 2877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "40390df913754ddda6dc46279be008bc"
format_stamp: "Formatted at 2026-08-08 07:05:21 on dist-test-slave-rmhg"
server_key: "b44ca8600d21b6b2d99e8a2272b62d50"
server_key_iv: "8a4dafeb15a2a0e5bde6c3a30b5e549d"
server_key_version: "encryptionkey@0"
I20260808 07:05:21.191987 2877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "40390df913754ddda6dc46279be008bc"
format_stamp: "Formatted at 2026-08-08 07:05:21 on dist-test-slave-rmhg"
server_key: "b44ca8600d21b6b2d99e8a2272b62d50"
server_key_iv: "8a4dafeb15a2a0e5bde6c3a30b5e549d"
server_key_version: "encryptionkey@0"
I20260808 07:05:21.193323 2877 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:21.194000 2901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:21.194134 2877 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:21.194224 2877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "40390df913754ddda6dc46279be008bc"
format_stamp: "Formatted at 2026-08-08 07:05:21 on dist-test-slave-rmhg"
server_key: "b44ca8600d21b6b2d99e8a2272b62d50"
server_key_iv: "8a4dafeb15a2a0e5bde6c3a30b5e549d"
server_key_version: "encryptionkey@0"
I20260808 07:05:21.194288 2877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:21.205938 2877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:21.207787 2877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:21.207926 2877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:21.211766 2877 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:37561
I20260808 07:05:21.211802 2976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:37561 every 8 connection(s)
I20260808 07:05:21.212297 2877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:21.212983 2979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:21.215305 2979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc: Bootstrap starting.
I20260808 07:05:21.215898 2979 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:21.216171 2979 log.cc:824] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:21.216842 2979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc: No bootstrap required, opened a new log
I20260808 07:05:21.218437 2979 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40390df913754ddda6dc46279be008bc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 37561 } }
I20260808 07:05:21.218608 2979 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:21.218633 2979 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40390df913754ddda6dc46279be008bc, State: Initialized, Role: FOLLOWER
I20260808 07:05:21.218766 2979 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40390df913754ddda6dc46279be008bc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 37561 } }
I20260808 07:05:21.218839 2979 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:21.218861 2979 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:21.218887 2979 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:21.219377 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 2877
I20260808 07:05:21.219487 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:21.219651 30025 external_mini_cluster.cc:1428] Setting key 9e66824a270b9c98f3b4a008589c077a
I20260808 07:05:21.219930 2979 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40390df913754ddda6dc46279be008bc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 37561 } }
I20260808 07:05:21.220052 2979 leader_election.cc:302] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40390df913754ddda6dc46279be008bc; no voters:
I20260808 07:05:21.220227 2979 leader_election.cc:288] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:21.220265 2983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:21.220412 2983 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [term 1 LEADER]: Becoming Leader. State: Replica: 40390df913754ddda6dc46279be008bc, State: Running, Role: LEADER
I20260808 07:05:21.220494 2983 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40390df913754ddda6dc46279be008bc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 37561 } }
I20260808 07:05:21.220870 2987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40390df913754ddda6dc46279be008bc. Latest consensus state: current_term: 1 leader_uuid: "40390df913754ddda6dc46279be008bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40390df913754ddda6dc46279be008bc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 37561 } } }
I20260808 07:05:21.220975 2983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40390df913754ddda6dc46279be008bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40390df913754ddda6dc46279be008bc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 37561 } } }
I20260808 07:05:21.221091 2979 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:21.221071 2987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:21.221081 2983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:21.221418 2990 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:21.221987 2990 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:21.226671 2990 catalog_manager.cc:1347] Generated new cluster ID: 5537cf3ae525458c82750915da07b681
I20260808 07:05:21.226727 2990 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[2857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:21.231267 2985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.220124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41390 (local address 127.29.82.126:37561)
0808 07:05:21.220363 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:21.220373 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:21.220412 (+ 39us) server_negotiation.cc:407] Connection header received
0808 07:05:21.220535 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:21.220542 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:21.220624 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:21.220773 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:21.221664 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.223025 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.223757 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.224379 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.224521 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:21.227541 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:21.227545 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:21.227546 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:21.227558 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:21.229526 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.229946 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.229949 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.229949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.230069 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.230304 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.230305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.230306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.230615 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:21.230768 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:21.230902 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 07:05:21.231047 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":100,"threads_started":1}
I20260808 07:05:21.252009 2990 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:21.252588 2990 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:21.258704 2990 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40390df913754ddda6dc46279be008bc: Generated new TSK 0
I20260808 07:05:21.258920 2990 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:05:21.288655 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:37561
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:21.374459 3015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:21.374692 3015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:21.374727 3015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:21.376001 3015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:21.376053 3015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:21.376089 3015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:05:21.377699 3015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:37561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:21.377947 3015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:21.378170 3015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:21.383631 3021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:21.383625 3025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:21.383627 3022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:21.383666 3015 server_base.cc:1034] running on GCE node
I20260808 07:05:21.384002 3015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:21.384248 3015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:21.385390 3015 hybrid_clock.cc:648] HybridClock initialized: now 1786172721385361 us; error 49 us; skew 500 ppm
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[2857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172721, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:21.388046 3015 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:05:21.388546 3015 webserver.cc:460] Webserver started at http://127.29.82.65:45177/ using document root <none> and password file <none>
I20260808 07:05:21.388764 3015 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:21.388814 3015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:21.388952 3015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:21.390107 3015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "382970fc22b448c2b1290e5ca8853e41"
format_stamp: "Formatted at 2026-08-08 07:05:21 on dist-test-slave-rmhg"
server_key: "21569f0f92d4d2e3c4fb7d5089c5a613"
server_key_iv: "7a984157d9ecf59b00cf574848e12860"
server_key_version: "encryptionkey@0"
I20260808 07:05:21.390466 3015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "382970fc22b448c2b1290e5ca8853e41"
format_stamp: "Formatted at 2026-08-08 07:05:21 on dist-test-slave-rmhg"
server_key: "21569f0f92d4d2e3c4fb7d5089c5a613"
server_key_iv: "7a984157d9ecf59b00cf574848e12860"
server_key_version: "encryptionkey@0"
I20260808 07:05:21.391841 3015 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:21.392640 3036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:21.392818 3015 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:21.392910 3015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "382970fc22b448c2b1290e5ca8853e41"
format_stamp: "Formatted at 2026-08-08 07:05:21 on dist-test-slave-rmhg"
server_key: "21569f0f92d4d2e3c4fb7d5089c5a613"
server_key_iv: "7a984157d9ecf59b00cf574848e12860"
server_key_version: "encryptionkey@0"
I20260808 07:05:21.392977 3015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:21.415455 3015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:21.417515 3015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:21.417657 3015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:21.417897 3015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:21.418228 3015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:21.418263 3015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:21.418293 3015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:21.418318 3015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:21.424252 3015 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:41065
I20260808 07:05:21.424346 3198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:41065 every 8 connection(s)
I20260808 07:05:21.424659 3015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:05:21.425199 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 3015
I20260808 07:05:21.425288 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:21.425469 30025 external_mini_cluster.cc:1428] Setting key 0b7cb525b8fef8c9eed1577aa3ef8c39
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[2857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172721, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
I20260808 07:05:21.435309 2985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.425997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:50913 (local address 127.29.82.126:37561)
0808 07:05:21.426053 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:21.426055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:21.426353 (+ 298us) server_negotiation.cc:407] Connection header received
0808 07:05:21.427548 (+ 1195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:21.427549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:21.427564 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:21.427615 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:21.428432 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.428949 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.430016 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.430232 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.430292 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:21.432523 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:21.432525 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:21.432525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:21.432535 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:21.433930 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.434323 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.434324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.434325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.434386 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.434645 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.434647 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.434647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.434765 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:21.434825 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:21.435111 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 07:05:21.435205 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:05:21.435480 3207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.425985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:37561 (local address 127.29.82.65:50913)
0808 07:05:21.426189 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:21.426243 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:21.427421 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:21.427697 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:21.427701 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:21.428075 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:21.428327 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:21.428332 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.429042 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.429043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:21.429923 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:21.429925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.430307 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.430308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:21.430467 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:21.431031 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:21.431040 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:21.432419 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:21.434014 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:21.434022 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:21.434025 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:21.434257 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:21.434440 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:21.434441 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:21.434442 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:21.434582 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:21.434822 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:21.434829 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:21.434986 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 07:05:21.435080 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 07:05:21.435249 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":104,"threads_started":1}
I20260808 07:05:21.436064 3204 heartbeater.cc:347] Connected to a master server at 127.29.82.126:37561
I20260808 07:05:21.436163 3204 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:21.436328 3204 heartbeater.cc:511] Master 127.29.82.126:37561 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
I20260808 07:05:21.436920 2924 ts_manager.cc:194] Registered new tserver with Master: 382970fc22b448c2b1290e5ca8853e41 (127.29.82.65:41065)
I20260808 07:05:21.437793 2924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:50913
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:05:21.452637 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:37561
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:21.537180 3212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:21.537408 3212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:21.537439 3212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:21.538600 3212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:21.538643 3212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:21.538679 3212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:05:21.540215 3212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:37561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:21.540462 3212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:21.540697 3212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:21.545755 3222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:21.545771 3224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:21.545863 3212 server_base.cc:1034] running on GCE node
W20260808 07:05:21.545771 3220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:21.546273 3212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:21.546533 3212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:21.547694 3212 hybrid_clock.cc:648] HybridClock initialized: now 1786172721547679 us; error 29 us; skew 500 ppm
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[2857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172721, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:21.550333 3212 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:05:21.550818 3212 webserver.cc:460] Webserver started at http://127.29.82.66:41643/ using document root <none> and password file <none>
I20260808 07:05:21.551030 3212 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:21.551080 3212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:21.551209 3212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:21.552296 3212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "705f489eea5f4b91acadd057eab53bb4"
format_stamp: "Formatted at 2026-08-08 07:05:21 on dist-test-slave-rmhg"
server_key: "c9120cde5f6e68594df20d6e6837e1a6"
server_key_iv: "a6f10984e3c3ef334eb6953df6556a7c"
server_key_version: "encryptionkey@0"
I20260808 07:05:21.552650 3212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "705f489eea5f4b91acadd057eab53bb4"
format_stamp: "Formatted at 2026-08-08 07:05:21 on dist-test-slave-rmhg"
server_key: "c9120cde5f6e68594df20d6e6837e1a6"
server_key_iv: "a6f10984e3c3ef334eb6953df6556a7c"
server_key_version: "encryptionkey@0"
I20260808 07:05:21.554056 3212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:21.554800 3232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:21.554986 3212 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:21.555084 3212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "705f489eea5f4b91acadd057eab53bb4"
format_stamp: "Formatted at 2026-08-08 07:05:21 on dist-test-slave-rmhg"
server_key: "c9120cde5f6e68594df20d6e6837e1a6"
server_key_iv: "a6f10984e3c3ef334eb6953df6556a7c"
server_key_version: "encryptionkey@0"
I20260808 07:05:21.555151 3212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:21.564816 3212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:21.566820 3212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:21.566962 3212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:21.567183 3212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:21.567490 3212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:21.567524 3212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:21.567554 3212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:21.567579 3212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:21.573132 3212 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:40953
I20260808 07:05:21.573213 3406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:40953 every 8 connection(s)
I20260808 07:05:21.573565 3212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:05:21.578660 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 3212
I20260808 07:05:21.578783 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:21.578991 30025 external_mini_cluster.cc:1428] Setting key e33826f47544427367d82744421dcb8c
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[2857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172721, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:21.583204 2985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.574292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:46123 (local address 127.29.82.126:37561)
0808 07:05:21.574349 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:21.574351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:21.574537 (+ 186us) server_negotiation.cc:407] Connection header received
0808 07:05:21.575487 (+ 950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:21.575488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:21.575502 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:21.575556 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:21.576208 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.576716 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.577767 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.577963 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.578021 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:21.580359 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:21.580360 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:21.580361 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:21.580369 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:21.581796 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.582246 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.582248 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.582248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.582314 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.582569 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.582570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.582570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.582692 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:21.582755 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:21.583056 (+ 301us) server_negotiation.cc:299] Negotiation successful
0808 07:05:21.583136 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:05:21.583454 3410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.574256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:37561 (local address 127.29.82.66:46123)
0808 07:05:21.574425 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:21.574461 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:21.575383 (+ 922us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:21.575654 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:21.575658 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:21.575921 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:21.576116 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:21.576121 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.576796 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.576797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:21.577688 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:21.577690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.578034 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.578034 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:21.578160 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:21.578709 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:21.578720 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:21.580265 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:21.581887 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:21.581897 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:21.581899 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:21.582175 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:21.582373 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:21.582374 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:21.582374 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:21.582512 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:21.582753 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:21.582759 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:21.582929 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 07:05:21.583047 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 07:05:21.583219 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":85,"threads_started":1}
I20260808 07:05:21.584081 3407 heartbeater.cc:347] Connected to a master server at 127.29.82.126:37561
I20260808 07:05:21.584192 3407 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:21.584379 3407 heartbeater.cc:511] Master 127.29.82.126:37561 requested a full tablet report, sending...
I20260808 07:05:21.584836 2924 ts_manager.cc:194] Registered new tserver with Master: 705f489eea5f4b91acadd057eab53bb4 (127.29.82.66:40953)
I20260808 07:05:21.585289 2924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:46123
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:05:21.608291 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:37561
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:21.692318 3414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:21.692605 3414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:21.692641 3414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:21.693866 3414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:21.693910 3414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:21.693944 3414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:05:21.695493 3414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:37561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:21.695742 3414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:21.695976 3414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:21.700981 3421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:21.701010 3426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:21.701004 3420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:21.701184 3414 server_base.cc:1034] running on GCE node
I20260808 07:05:21.701452 3414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:21.701699 3414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:21.702862 3414 hybrid_clock.cc:648] HybridClock initialized: now 1786172721702839 us; error 43 us; skew 500 ppm
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[2857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172721, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:21.705765 3414 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:05:21.706324 3414 webserver.cc:460] Webserver started at http://127.29.82.67:44347/ using document root <none> and password file <none>
I20260808 07:05:21.706635 3414 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:21.706704 3414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:21.706846 3414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:21.708192 3414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "96072202e82d476ea374bac5c71c342a"
format_stamp: "Formatted at 2026-08-08 07:05:21 on dist-test-slave-rmhg"
server_key: "d6853bfae44388658b296edb08b359a6"
server_key_iv: "3cbe66cda75d755689ecc6352d951e6b"
server_key_version: "encryptionkey@0"
I20260808 07:05:21.708500 3414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "96072202e82d476ea374bac5c71c342a"
format_stamp: "Formatted at 2026-08-08 07:05:21 on dist-test-slave-rmhg"
server_key: "d6853bfae44388658b296edb08b359a6"
server_key_iv: "3cbe66cda75d755689ecc6352d951e6b"
server_key_version: "encryptionkey@0"
I20260808 07:05:21.709776 3414 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:21.710397 3445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:21.710541 3414 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:21.710626 3414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "96072202e82d476ea374bac5c71c342a"
format_stamp: "Formatted at 2026-08-08 07:05:21 on dist-test-slave-rmhg"
server_key: "d6853bfae44388658b296edb08b359a6"
server_key_iv: "3cbe66cda75d755689ecc6352d951e6b"
server_key_version: "encryptionkey@0"
I20260808 07:05:21.710695 3414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:21.734028 3414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:21.736320 3414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:21.736596 3414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:21.736913 3414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:21.737287 3414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:21.737335 3414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:21.737366 3414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:21.737390 3414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:21.743098 3414 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:44379
I20260808 07:05:21.743149 3631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:44379 every 8 connection(s)
I20260808 07:05:21.743466 3414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:05:21.744581 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 3414
I20260808 07:05:21.744709 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:21.744885 30025 external_mini_cluster.cc:1428] Setting key fcaf11d0ce69a24fa10344f12299738c
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[2857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172721, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:21.752887 2985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.744196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:53801 (local address 127.29.82.126:37561)
0808 07:05:21.744256 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:21.744259 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:21.744457 (+ 198us) server_negotiation.cc:407] Connection header received
0808 07:05:21.745658 (+ 1201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:21.745659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:21.745671 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:21.745718 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:21.746411 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.746917 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.747889 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.748063 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.748114 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:21.750344 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:21.750346 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:21.750346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:21.750354 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:21.751682 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.752086 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.752087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.752088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.752149 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.752351 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.752351 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.752351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.752469 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:21.752524 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:21.752750 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 07:05:21.752816 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:05:21.753046 3635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.744158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:37561 (local address 127.29.82.67:53801)
0808 07:05:21.744304 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:21.744346 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:21.745569 (+ 1223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:21.745782 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:21.745786 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:21.746085 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:21.746304 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:21.746309 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.746993 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.746993 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:21.747827 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:21.747829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.748134 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.748135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:21.748239 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:21.748738 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:21.748747 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:21.750252 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:21.751770 (+ 1518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:21.751777 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:21.751780 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:21.752000 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:21.752206 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:21.752207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:21.752207 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:21.752304 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:21.752520 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:21.752523 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:21.752647 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 07:05:21.752726 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 07:05:21.752852 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":67,"threads_started":1}
I20260808 07:05:21.753533 3632 heartbeater.cc:347] Connected to a master server at 127.29.82.126:37561
I20260808 07:05:21.753639 3632 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:21.753823 3632 heartbeater.cc:511] Master 127.29.82.126:37561 requested a full tablet report, sending...
I20260808 07:05:21.754213 2924 ts_manager.cc:194] Registered new tserver with Master: 96072202e82d476ea374bac5c71c342a (127.29.82.67:44379)
I20260808 07:05:21.754573 2924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:53801
I20260808 07:05:21.756606 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[2857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[2857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.65@KRBTEST.COM
I20260808 07:05:21.780866 3643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.773391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38342 (local address 127.29.82.65:41065)
0808 07:05:21.773574 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:21.773580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:21.773591 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:05:21.773619 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:21.773621 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:21.773637 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:21.773707 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:21.774268 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.775030 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.775746 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.776083 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.776139 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:21.778372 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:21.778382 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:21.778383 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:21.778390 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:21.779785 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.780167 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.780170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.780170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.780227 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.780390 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.780391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.780391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.780522 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:21.780642 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:21.780716 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 07:05:21.780783 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[2857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:21.788803 2985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.782216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41392 (local address 127.29.82.126:37561)
0808 07:05:21.782265 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:21.782267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:21.782291 (+ 24us) server_negotiation.cc:407] Connection header received
0808 07:05:21.782313 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:21.782313 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:21.782322 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:21.782357 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:21.782787 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.783282 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.783915 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.784099 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.784143 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:21.786359 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:21.786361 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:21.786361 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:21.786369 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:21.787633 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.787983 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.787985 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.787985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.788056 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.788294 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.788295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.788295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.788467 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:21.788556 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:21.788662 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 07:05:21.788733 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 07:05:21.789065 2924 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41392
I20260808 07:05:21.789430 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 3015
I20260808 07:05:21.801127 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 3212
I20260808 07:05:21.811724 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 3414
I20260808 07:05:21.832489 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 2877
2026-08-08T07:05:21Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1994 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[3650](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[3650](info): set up 2 sockets
Aug 08 07:05:21 dist-test-slave-rmhg krb5kdc[3650](info): commencing operation
krb5kdc: starting...
W20260808 07:05:22.955804 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:05:23 dist-test-slave-rmhg krb5kdc[3650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:05:23.078140 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:33457
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:33457
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:23.161264 3668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:23.161490 3668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:23.161525 3668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:23.162714 3668 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:23.162753 3668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:23.162770 3668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:23.162786 3668 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:23.162801 3668 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:23.164358 3668 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:33457
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:33457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:23.164639 3668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:23.164857 3668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:23.169658 3674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:23.169695 3678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:23.169860 3668 server_base.cc:1034] running on GCE node
W20260808 07:05:23.169670 3682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:23.170166 3668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:23.170419 3668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:23.171553 3668 hybrid_clock.cc:648] HybridClock initialized: now 1786172723171539 us; error 31 us; skew 500 ppm
Aug 08 07:05:23 dist-test-slave-rmhg krb5kdc[3650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172723, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:23.173983 3668 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:05:23.174335 3668 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:23.174388 3668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:23.174518 3668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:23.175628 3668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "61b2d0f5bd244754a08c59c190d60702"
format_stamp: "Formatted at 2026-08-08 07:05:23 on dist-test-slave-rmhg"
server_key: "6e4ba996a547e6864c9c5a77d1859ba1"
server_key_iv: "0c0ad9029fe73e7e6cae15ab2b23ed46"
server_key_version: "encryptionkey@0"
I20260808 07:05:23.175988 3668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "61b2d0f5bd244754a08c59c190d60702"
format_stamp: "Formatted at 2026-08-08 07:05:23 on dist-test-slave-rmhg"
server_key: "6e4ba996a547e6864c9c5a77d1859ba1"
server_key_iv: "0c0ad9029fe73e7e6cae15ab2b23ed46"
server_key_version: "encryptionkey@0"
I20260808 07:05:23.177270 3668 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:23.177963 3689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:23.178117 3668 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:23.178205 3668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "61b2d0f5bd244754a08c59c190d60702"
format_stamp: "Formatted at 2026-08-08 07:05:23 on dist-test-slave-rmhg"
server_key: "6e4ba996a547e6864c9c5a77d1859ba1"
server_key_iv: "0c0ad9029fe73e7e6cae15ab2b23ed46"
server_key_version: "encryptionkey@0"
I20260808 07:05:23.178272 3668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:23.204870 3668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:23.206982 3668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:23.207129 3668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:23.211014 3668 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:33457
I20260808 07:05:23.211045 3771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:33457 every 8 connection(s)
I20260808 07:05:23.211335 3668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:23.212316 3772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:23.214162 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 3668
I20260808 07:05:23.214259 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:23.214421 30025 external_mini_cluster.cc:1428] Setting key 446183bc8f6dccac66b6705dfbafb18b
I20260808 07:05:23.215117 3772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702: Bootstrap starting.
I20260808 07:05:23.215734 3772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:23.216086 3772 log.cc:824] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:23.216799 3772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702: No bootstrap required, opened a new log
I20260808 07:05:23.218632 3772 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b2d0f5bd244754a08c59c190d60702" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 33457 } }
I20260808 07:05:23.218775 3772 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:23.218808 3772 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b2d0f5bd244754a08c59c190d60702, State: Initialized, Role: FOLLOWER
I20260808 07:05:23.218963 3772 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b2d0f5bd244754a08c59c190d60702" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 33457 } }
I20260808 07:05:23.219038 3772 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:23.219070 3772 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:23.219127 3772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:23.219853 3772 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b2d0f5bd244754a08c59c190d60702" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 33457 } }
I20260808 07:05:23.219983 3772 leader_election.cc:302] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61b2d0f5bd244754a08c59c190d60702; no voters:
I20260808 07:05:23.220203 3772 leader_election.cc:288] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:23.220264 3778 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:23.220439 3778 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [term 1 LEADER]: Becoming Leader. State: Replica: 61b2d0f5bd244754a08c59c190d60702, State: Running, Role: LEADER
I20260808 07:05:23.220490 3772 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:23.220548 3778 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b2d0f5bd244754a08c59c190d60702" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 33457 } }
Aug 08 07:05:23 dist-test-slave-rmhg krb5kdc[3650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:23.220955 3778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61b2d0f5bd244754a08c59c190d60702. Latest consensus state: current_term: 1 leader_uuid: "61b2d0f5bd244754a08c59c190d60702" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b2d0f5bd244754a08c59c190d60702" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 33457 } } }
I20260808 07:05:23.220964 3780 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61b2d0f5bd244754a08c59c190d60702" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b2d0f5bd244754a08c59c190d60702" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 33457 } } }
I20260808 07:05:23.221062 3778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:23.221446 3780 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702 [sys.catalog]: This master's current role is: LEADER
W20260808 07:05:23.222476 3799 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:05:23.222787 3799 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:05:23.222990 3791 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:23.223152 3791 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:23.225191 3775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.214954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58566 (local address 127.29.82.126:33457)
0808 07:05:23.215105 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:23.215114 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:23.215141 (+ 27us) server_negotiation.cc:407] Connection header received
0808 07:05:23.215569 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:23.215576 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:23.215632 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:23.215750 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:23.216519 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.217522 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.218252 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.218681 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.218780 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.221562 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:23.221566 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:23.221567 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:23.221579 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:23.223487 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:23.223908 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:23.223911 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:23.223912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:23.224023 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:23.224237 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:23.224238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:23.224238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:23.224562 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:23.224729 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:23.224804 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 07:05:23.224946 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260808 07:05:23.225617 3791 catalog_manager.cc:1347] Generated new cluster ID: 799b2b4a2aeb4d8fb452db646d75c995
I20260808 07:05:23.225668 3791 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:23.252514 3791 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:23.253070 3791 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:23.260027 3791 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702: Generated new TSK 0
I20260808 07:05:23.260222 3791 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:05:23.300493 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:33457
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:23.401400 3809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:23.401613 3809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:23.401645 3809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:23.402812 3809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:23.402851 3809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:23.402886 3809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:05:23.404399 3809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:33457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:23.404687 3809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:23.404904 3809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:23.409816 3822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:23.409950 3818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:23.410055 3809 server_base.cc:1034] running on GCE node
W20260808 07:05:23.410104 3820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:23.410323 3809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:23.410555 3809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:23.411697 3809 hybrid_clock.cc:648] HybridClock initialized: now 1786172723411687 us; error 39 us; skew 500 ppm
Aug 08 07:05:23 dist-test-slave-rmhg krb5kdc[3650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172723, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:23.414211 3809 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:05:23.414539 3809 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:23.414590 3809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:23.414719 3809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:23.415767 3809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "1aa05d969e4441e2b939cfd925e51410"
format_stamp: "Formatted at 2026-08-08 07:05:23 on dist-test-slave-rmhg"
server_key: "4a074e7403b457b70eaa8149544161aa"
server_key_iv: "efc55f230fce52061b5d44229bb99513"
server_key_version: "encryptionkey@0"
I20260808 07:05:23.416086 3809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "1aa05d969e4441e2b939cfd925e51410"
format_stamp: "Formatted at 2026-08-08 07:05:23 on dist-test-slave-rmhg"
server_key: "4a074e7403b457b70eaa8149544161aa"
server_key_iv: "efc55f230fce52061b5d44229bb99513"
server_key_version: "encryptionkey@0"
I20260808 07:05:23.417375 3809 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:23.418040 3830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:23.418220 3809 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:23.418305 3809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "1aa05d969e4441e2b939cfd925e51410"
format_stamp: "Formatted at 2026-08-08 07:05:23 on dist-test-slave-rmhg"
server_key: "4a074e7403b457b70eaa8149544161aa"
server_key_iv: "efc55f230fce52061b5d44229bb99513"
server_key_version: "encryptionkey@0"
I20260808 07:05:23.418362 3809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:23.429535 3809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:23.431612 3809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:23.431759 3809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:23.432014 3809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:23.432325 3809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:23.432358 3809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:23.432387 3809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:23.432404 3809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:23.438163 3809 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:45983
I20260808 07:05:23.438246 3996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:45983 every 8 connection(s)
I20260808 07:05:23.438490 3809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:05:23 dist-test-slave-rmhg krb5kdc[3650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172723, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:23.447255 3775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.439224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:41119 (local address 127.29.82.126:33457)
0808 07:05:23.439310 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:23.439312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:23.439474 (+ 162us) server_negotiation.cc:407] Connection header received
0808 07:05:23.439972 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:23.439974 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:23.439987 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:23.440040 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:23.440997 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.441553 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.442543 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.442766 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.442824 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.444845 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:23.444846 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:23.444847 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:23.444855 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:23.445994 (+ 1139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:23.446363 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:23.446365 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:23.446365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:23.446419 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:23.446635 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:23.446636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:23.446637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:23.446750 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:23.446810 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:23.447072 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 07:05:23.447161 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 07:05:23.447465 3999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.439178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:33457 (local address 127.29.82.65:41119)
0808 07:05:23.439347 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:23.439388 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:23.439863 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:23.440122 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:23.440126 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:23.440390 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:23.440894 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.440899 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.441640 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.441641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.442462 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.442464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.442838 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.442839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.442956 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.443404 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:23.443413 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:23.444757 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:23.446067 (+ 1310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:23.446073 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:23.446076 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:23.446297 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:23.446472 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:23.446473 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:23.446474 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:23.446573 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:23.446806 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:23.446812 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:23.446951 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 07:05:23.447043 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 07:05:23.447213 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":74,"threads_started":1}
I20260808 07:05:23.447510 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 3809
I20260808 07:05:23.447645 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:23.447850 30025 external_mini_cluster.cc:1428] Setting key 602d645e299e7d9d2480ab637e6b4b80
I20260808 07:05:23.447933 3997 heartbeater.cc:347] Connected to a master server at 127.29.82.126:33457
I20260808 07:05:23.448036 3997 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:23.448201 3997 heartbeater.cc:511] Master 127.29.82.126:33457 requested a full tablet report, sending...
I20260808 07:05:23.448745 3718 ts_manager.cc:194] Registered new tserver with Master: 1aa05d969e4441e2b939cfd925e51410 (127.29.82.65:45983)
I20260808 07:05:23.449409 3718 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:41119
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:05:23.473481 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:33457
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:23.555750 4003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:23.555968 4003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:23.556001 4003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:23.557406 4003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:23.557507 4003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:23.557548 4003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:05:23.559195 4003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:33457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:23.559458 4003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:23.559684 4003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:23.564595 4010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:23.564684 4009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:23.564595 4012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:23.564918 4003 server_base.cc:1034] running on GCE node
I20260808 07:05:23.565124 4003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:23.565419 4003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:23.566555 4003 hybrid_clock.cc:648] HybridClock initialized: now 1786172723566538 us; error 34 us; skew 500 ppm
Aug 08 07:05:23 dist-test-slave-rmhg krb5kdc[3650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172723, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:23.568946 4003 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:05:23.569339 4003 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:23.569396 4003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:23.569523 4003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:23.570573 4003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "87feaa62486d404681445ed36a2bddf8"
format_stamp: "Formatted at 2026-08-08 07:05:23 on dist-test-slave-rmhg"
server_key: "45c982a3231dfaeb3d7c4bf24f38fe0a"
server_key_iv: "fe3ba9ba48f264c01641e496a70f92a0"
server_key_version: "encryptionkey@0"
I20260808 07:05:23.570906 4003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "87feaa62486d404681445ed36a2bddf8"
format_stamp: "Formatted at 2026-08-08 07:05:23 on dist-test-slave-rmhg"
server_key: "45c982a3231dfaeb3d7c4bf24f38fe0a"
server_key_iv: "fe3ba9ba48f264c01641e496a70f92a0"
server_key_version: "encryptionkey@0"
I20260808 07:05:23.572281 4003 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:23.572947 4019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:23.573101 4003 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:23.573215 4003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "87feaa62486d404681445ed36a2bddf8"
format_stamp: "Formatted at 2026-08-08 07:05:23 on dist-test-slave-rmhg"
server_key: "45c982a3231dfaeb3d7c4bf24f38fe0a"
server_key_iv: "fe3ba9ba48f264c01641e496a70f92a0"
server_key_version: "encryptionkey@0"
I20260808 07:05:23.573284 4003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:23.598291 4003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:23.600268 4003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:23.600415 4003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:23.600651 4003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:23.600983 4003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:23.601019 4003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:23.601050 4003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:23.601068 4003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:23.606861 4003 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:33141
I20260808 07:05:23.606915 4185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:33141 every 8 connection(s)
I20260808 07:05:23.607199 4003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:05:23.609122 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 4003
I20260808 07:05:23.609238 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:23.609422 30025 external_mini_cluster.cc:1428] Setting key 6fe3a8890937d0c1175661d86512d420
Aug 08 07:05:23 dist-test-slave-rmhg krb5kdc[3650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172723, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:23.616570 3775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.607895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:36545 (local address 127.29.82.126:33457)
0808 07:05:23.607956 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:23.607958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:23.608166 (+ 208us) server_negotiation.cc:407] Connection header received
0808 07:05:23.608645 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:23.608646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:23.608656 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:23.608711 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:23.609838 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.610403 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.611423 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.611678 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.611746 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.613835 (+ 2089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:23.613837 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:23.613837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:23.613845 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:23.615302 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:23.615678 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:23.615679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:23.615680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:23.615745 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:23.615949 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:23.615950 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:23.615950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:23.616097 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:23.616165 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:23.616383 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 07:05:23.616467 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:05:23.616648 4189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.607847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:33457 (local address 127.29.82.66:36545)
0808 07:05:23.608038 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:23.608082 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:23.608568 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:23.608769 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:23.608772 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:23.609033 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:23.609741 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.609749 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.610488 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.610490 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.611332 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.611334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.611768 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.611770 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.611886 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.612368 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:23.612377 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:23.613746 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:23.615382 (+ 1636us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:23.615388 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:23.615390 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:23.615605 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:23.615804 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:23.615804 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:23.615804 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:23.615895 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:23.616152 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:23.616155 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:23.616271 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 07:05:23.616349 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 07:05:23.616473 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":94,"threads_started":1}
I20260808 07:05:23.617111 4187 heartbeater.cc:347] Connected to a master server at 127.29.82.126:33457
I20260808 07:05:23.617239 4187 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:23.617393 4187 heartbeater.cc:511] Master 127.29.82.126:33457 requested a full tablet report, sending...
I20260808 07:05:23.617759 3718 ts_manager.cc:194] Registered new tserver with Master: 87feaa62486d404681445ed36a2bddf8 (127.29.82.66:33141)
I20260808 07:05:23.618131 3718 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:36545
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:05:23.635417 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:33457
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:23.718125 4194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:23.718326 4194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:23.718349 4194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:23.719458 4194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:23.719491 4194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:23.719514 4194 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:05:23.721098 4194 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:33457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:23.721377 4194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:23.721732 4194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:23.726894 4207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:23.726882 4202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:23.726882 4201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:23.727097 4194 server_base.cc:1034] running on GCE node
I20260808 07:05:23.727298 4194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:23.727543 4194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:23.728690 4194 hybrid_clock.cc:648] HybridClock initialized: now 1786172723728674 us; error 33 us; skew 500 ppm
Aug 08 07:05:23 dist-test-slave-rmhg krb5kdc[3650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172723, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:23.731266 4194 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:05:23.731649 4194 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:23.731701 4194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:23.731832 4194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:23.732899 4194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "a6417660f0db4da680a22b27e1fb04d0"
format_stamp: "Formatted at 2026-08-08 07:05:23 on dist-test-slave-rmhg"
server_key: "ec71184b58c4a49aa5e6e795e46fd18b"
server_key_iv: "573b409ced1a2d63e84893a6df6c011e"
server_key_version: "encryptionkey@0"
I20260808 07:05:23.733271 4194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "a6417660f0db4da680a22b27e1fb04d0"
format_stamp: "Formatted at 2026-08-08 07:05:23 on dist-test-slave-rmhg"
server_key: "ec71184b58c4a49aa5e6e795e46fd18b"
server_key_iv: "573b409ced1a2d63e84893a6df6c011e"
server_key_version: "encryptionkey@0"
I20260808 07:05:23.734534 4194 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:23.735312 4218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:23.735519 4194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:23.735610 4194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "a6417660f0db4da680a22b27e1fb04d0"
format_stamp: "Formatted at 2026-08-08 07:05:23 on dist-test-slave-rmhg"
server_key: "ec71184b58c4a49aa5e6e795e46fd18b"
server_key_iv: "573b409ced1a2d63e84893a6df6c011e"
server_key_version: "encryptionkey@0"
I20260808 07:05:23.735677 4194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:23.758386 4194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:23.760454 4194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:23.760603 4194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:23.760813 4194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:23.761106 4194 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:23.761137 4194 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:23.761185 4194 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:23.761211 4194 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:23.766749 4194 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:34703
I20260808 07:05:23.766783 4395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:34703 every 8 connection(s)
I20260808 07:05:23.767062 4194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:05:23.770773 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 4194
I20260808 07:05:23.770891 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:23.771103 30025 external_mini_cluster.cc:1428] Setting key c65b326172ee8eb08fcccdbfce45fba1
Aug 08 07:05:23 dist-test-slave-rmhg krb5kdc[3650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172723, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:23.776712 3775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.767795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:52583 (local address 127.29.82.126:33457)
0808 07:05:23.767859 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:23.767861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:23.768044 (+ 183us) server_negotiation.cc:407] Connection header received
0808 07:05:23.768550 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:23.768551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:23.768563 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:23.768626 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:23.769664 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.770166 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.771576 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.771851 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.771916 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.774095 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:23.774096 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:23.774096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:23.774103 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:23.775436 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:23.775844 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:23.775845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:23.775846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:23.775910 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:23.776118 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:23.776118 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:23.776119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:23.776221 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:23.776268 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:23.776567 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 07:05:23.776637 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:05:23.776830 4399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.767756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:33457 (local address 127.29.82.67:52583)
0808 07:05:23.767919 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:23.767963 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:23.768426 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:23.768697 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:23.768701 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:23.768980 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:23.769572 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.769579 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.770277 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.770278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.771499 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.771502 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.771934 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.771935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.772075 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.772566 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:23.772576 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:23.774012 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:23.775520 (+ 1508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:23.775527 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:23.775534 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:23.775764 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:23.775964 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:23.775965 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:23.775965 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:23.776068 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:23.776263 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:23.776266 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:23.776387 (+ 121us) client_negotiation.cc:769] Sending connection context
0808 07:05:23.776507 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 07:05:23.776642 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
I20260808 07:05:23.777334 4396 heartbeater.cc:347] Connected to a master server at 127.29.82.126:33457
I20260808 07:05:23.777427 4396 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:23.777563 4396 heartbeater.cc:511] Master 127.29.82.126:33457 requested a full tablet report, sending...
I20260808 07:05:23.777938 3718 ts_manager.cc:194] Registered new tserver with Master: a6417660f0db4da680a22b27e1fb04d0 (127.29.82.67:34703)
I20260808 07:05:23.778291 3718 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:52583
I20260808 07:05:23.782737 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:05:23.789669 3775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.784022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58570 (local address 127.29.82.126:33457)
0808 07:05:23.784067 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:23.784069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:23.784145 (+ 76us) server_negotiation.cc:407] Connection header received
0808 07:05:23.784193 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:23.784194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:23.784202 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:23.784243 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:23.784780 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.785316 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.786108 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.786293 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.786346 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.787611 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:23.787612 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:23.787613 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:23.787619 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:23.788733 (+ 1114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:23.789032 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:23.789032 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:23.789033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:23.789080 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:23.789239 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:23.789240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:23.789240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:23.789385 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:23.789460 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:23.789538 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 07:05:23.789601 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:05:23.791291 3718 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58570:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:23.792902 3718 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:23.799604 4412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.795434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:33141 (local address 127.0.0.1:57974)
0808 07:05:23.795797 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:23.795843 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:23.796001 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:23.796323 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:23.796327 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:23.796330 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:23.796402 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.796405 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.797314 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.797315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.798447 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.798450 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.799295 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.799297 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.799382 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.799398 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 07:05:23.799472 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 07:05:23.799523 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":66,"threads_started":1}
I20260808 07:05:23.799621 4414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.795607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57974 (local address 127.29.82.66:33141)
0808 07:05:23.795946 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:23.795950 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:23.795960 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:05:23.796143 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:23.796146 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:23.796163 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:23.796228 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:23.796482 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.797230 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.798550 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.799205 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.799288 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.799350 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:23.799495 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 07:05:23.799536 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":94,"threads_started":1}
I20260808 07:05:23.799933 4413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.795656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:34703 (local address 127.0.0.1:37992)
0808 07:05:23.796066 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:23.796075 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:23.796124 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:23.796333 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:23.796334 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:23.796336 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:23.796416 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.796418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.797776 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.797777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.798740 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.798741 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.799717 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.799718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.799793 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.799799 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:05:23.799843 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:05:23.799877 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":73,"threads_started":1}
I20260808 07:05:23.800071 4417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.795755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37992 (local address 127.29.82.67:34703)
0808 07:05:23.795907 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:23.795913 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:23.796182 (+ 269us) server_negotiation.cc:407] Connection header received
0808 07:05:23.796228 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:23.796230 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:23.796244 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:23.796314 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:23.796500 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.797676 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.798833 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.799551 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.799619 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.799676 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:23.799867 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 07:05:23.799911 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":74,"threads_started":1}
I20260808 07:05:23.800621 4096 tablet_service.cc:1467] Processing CreateTablet for tablet 61457d75370446f2ae86aaf18c9524a0 (DEFAULT_TABLE table=test-table [id=2bd40a8f3152459a9c91dd2842a27047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:23.800730 4292 tablet_service.cc:1467] Processing CreateTablet for tablet 61457d75370446f2ae86aaf18c9524a0 (DEFAULT_TABLE table=test-table [id=2bd40a8f3152459a9c91dd2842a27047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:23.801033 4096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61457d75370446f2ae86aaf18c9524a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:23.801033 4292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61457d75370446f2ae86aaf18c9524a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:23.802143 4415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.795455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:45983 (local address 127.0.0.1:39626)
0808 07:05:23.796018 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:23.796028 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:23.796082 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:23.796379 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:23.796380 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:23.796381 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:23.796416 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.796418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.798809 (+ 2391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.798809 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.799581 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.799583 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.801892 (+ 2309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.801893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.801960 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.801964 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:23.802020 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 07:05:23.802066 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":88,"threads_started":1}
I20260808 07:05:23.802157 4418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.795831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39626 (local address 127.29.82.65:45983)
0808 07:05:23.796016 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:23.796021 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:23.796154 (+ 133us) server_negotiation.cc:407] Connection header received
0808 07:05:23.796201 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:23.796203 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:23.796220 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:23.796289 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:23.796497 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.797662 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.801214 (+ 3552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.801809 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.801879 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.801941 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:23.802034 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 07:05:23.802073 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":75,"threads_started":1}
I20260808 07:05:23.804539 4419 tablet_bootstrap.cc:492] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8: Bootstrap starting.
I20260808 07:05:23.805115 3896 tablet_service.cc:1467] Processing CreateTablet for tablet 61457d75370446f2ae86aaf18c9524a0 (DEFAULT_TABLE table=test-table [id=2bd40a8f3152459a9c91dd2842a27047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:23.805262 4419 tablet_bootstrap.cc:654] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:23.805333 4420 tablet_bootstrap.cc:492] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0: Bootstrap starting.
I20260808 07:05:23.805507 3896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61457d75370446f2ae86aaf18c9524a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:23.805886 4419 log.cc:824] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:23.806022 4420 tablet_bootstrap.cc:654] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:23.806593 4420 log.cc:824] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:23.806951 4419 tablet_bootstrap.cc:492] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8: No bootstrap required, opened a new log
I20260808 07:05:23.807027 4419 ts_tablet_manager.cc:1397] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 07:05:23.808415 4426 tablet_bootstrap.cc:492] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410: Bootstrap starting.
I20260808 07:05:23.808591 4419 raft_consensus.cc:348] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87feaa62486d404681445ed36a2bddf8" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 33141 } } peers { permanent_uuid: "a6417660f0db4da680a22b27e1fb04d0" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34703 } } peers { permanent_uuid: "1aa05d969e4441e2b939cfd925e51410" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 45983 } }
I20260808 07:05:23.808780 4419 raft_consensus.cc:374] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:23.808817 4419 raft_consensus.cc:729] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87feaa62486d404681445ed36a2bddf8, State: Initialized, Role: FOLLOWER
I20260808 07:05:23.808959 4420 tablet_bootstrap.cc:492] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0: No bootstrap required, opened a new log
I20260808 07:05:23.808944 4419 consensus_queue.cc:260] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87feaa62486d404681445ed36a2bddf8" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 33141 } } peers { permanent_uuid: "a6417660f0db4da680a22b27e1fb04d0" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34703 } } peers { permanent_uuid: "1aa05d969e4441e2b939cfd925e51410" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 45983 } }
I20260808 07:05:23.809036 4420 ts_tablet_manager.cc:1397] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 07:05:23.809187 4426 tablet_bootstrap.cc:654] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:23.809278 4419 ts_tablet_manager.cc:1428] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:05:23.809340 4187 heartbeater.cc:503] Master 127.29.82.126:33457 was elected leader, sending a full tablet report...
I20260808 07:05:23.809767 4426 log.cc:824] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:23.810556 4426 tablet_bootstrap.cc:492] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410: No bootstrap required, opened a new log
I20260808 07:05:23.810639 4426 ts_tablet_manager.cc:1397] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:05:23.810863 4420 raft_consensus.cc:348] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87feaa62486d404681445ed36a2bddf8" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 33141 } } peers { permanent_uuid: "a6417660f0db4da680a22b27e1fb04d0" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34703 } } peers { permanent_uuid: "1aa05d969e4441e2b939cfd925e51410" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 45983 } }
I20260808 07:05:23.811002 4420 raft_consensus.cc:374] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:23.811025 4420 raft_consensus.cc:729] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6417660f0db4da680a22b27e1fb04d0, State: Initialized, Role: FOLLOWER
I20260808 07:05:23.811137 4420 consensus_queue.cc:260] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87feaa62486d404681445ed36a2bddf8" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 33141 } } peers { permanent_uuid: "a6417660f0db4da680a22b27e1fb04d0" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34703 } } peers { permanent_uuid: "1aa05d969e4441e2b939cfd925e51410" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 45983 } }
I20260808 07:05:23.811408 4420 ts_tablet_manager.cc:1428] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:05:23.811434 4396 heartbeater.cc:503] Master 127.29.82.126:33457 was elected leader, sending a full tablet report...
I20260808 07:05:23.812543 4426 raft_consensus.cc:348] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87feaa62486d404681445ed36a2bddf8" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 33141 } } peers { permanent_uuid: "a6417660f0db4da680a22b27e1fb04d0" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34703 } } peers { permanent_uuid: "1aa05d969e4441e2b939cfd925e51410" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 45983 } }
I20260808 07:05:23.812677 4426 raft_consensus.cc:374] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:23.812711 4426 raft_consensus.cc:729] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1aa05d969e4441e2b939cfd925e51410, State: Initialized, Role: FOLLOWER
I20260808 07:05:23.812822 4426 consensus_queue.cc:260] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87feaa62486d404681445ed36a2bddf8" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 33141 } } peers { permanent_uuid: "a6417660f0db4da680a22b27e1fb04d0" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34703 } } peers { permanent_uuid: "1aa05d969e4441e2b939cfd925e51410" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 45983 } }
I20260808 07:05:23.813077 4426 ts_tablet_manager.cc:1428] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:05:23.813098 3997 heartbeater.cc:503] Master 127.29.82.126:33457 was elected leader, sending a full tablet report...
W20260808 07:05:23.857758 4188 tablet.cc:2369] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:23.889379 4433 raft_consensus.cc:482] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:23.889523 4433 raft_consensus.cc:504] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87feaa62486d404681445ed36a2bddf8" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 33141 } } peers { permanent_uuid: "a6417660f0db4da680a22b27e1fb04d0" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34703 } } peers { permanent_uuid: "1aa05d969e4441e2b939cfd925e51410" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 45983 } }
I20260808 07:05:23.889886 4433 leader_election.cc:288] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87feaa62486d404681445ed36a2bddf8 (127.29.82.66:33141), a6417660f0db4da680a22b27e1fb04d0 (127.29.82.67:34703)
I20260808 07:05:23.892707 4414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.890205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:40653 (local address 127.29.82.66:33141)
0808 07:05:23.890263 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:23.890265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:23.890274 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:05:23.890305 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:23.890305 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:23.890316 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:23.890372 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:23.890561 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.891034 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.892026 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.892390 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.892453 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.892462 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:23.892607 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 07:05:23.892643 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:05:23.892815 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.890223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:34703 (local address 127.29.82.65:47793)
0808 07:05:23.890422 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:23.890430 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:23.890478 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:23.890597 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:23.890598 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:23.890599 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:23.890681 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.890682 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.891278 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.891279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.892018 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.892020 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.892553 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.892554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.892632 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.892636 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:23.892682 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:05:23.892723 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":138,"threads_started":1}
I20260808 07:05:23.892803 4417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.890323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:47793 (local address 127.29.82.67:34703)
0808 07:05:23.890379 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:23.890381 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:23.890480 (+ 99us) server_negotiation.cc:407] Connection header received
0808 07:05:23.890534 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:23.890535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:23.890545 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:23.890587 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:23.890741 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.891203 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.892103 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.892477 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.892537 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.892546 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:23.892698 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 07:05:23.892737 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:05:23.892707 3999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.890114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:33141 (local address 127.29.82.65:40653)
0808 07:05:23.890165 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:23.890177 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:23.890227 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:23.890416 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:23.890418 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:23.890421 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:23.890486 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.890488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.891115 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.891116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.891920 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:23.891923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.892467 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.892468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:23.892542 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.892545 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:23.892590 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:05:23.892632 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 07:05:23.893255 4329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61457d75370446f2ae86aaf18c9524a0" candidate_uuid: "1aa05d969e4441e2b939cfd925e51410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6417660f0db4da680a22b27e1fb04d0" is_pre_election: true
I20260808 07:05:23.893354 4122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61457d75370446f2ae86aaf18c9524a0" candidate_uuid: "1aa05d969e4441e2b939cfd925e51410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87feaa62486d404681445ed36a2bddf8" is_pre_election: true
I20260808 07:05:23.893409 4329 raft_consensus.cc:2454] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1aa05d969e4441e2b939cfd925e51410 in term 0.
I20260808 07:05:23.893509 4122 raft_consensus.cc:2454] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1aa05d969e4441e2b939cfd925e51410 in term 0.
I20260808 07:05:23.893644 3831 leader_election.cc:302] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1aa05d969e4441e2b939cfd925e51410, a6417660f0db4da680a22b27e1fb04d0; no voters:
I20260808 07:05:23.893780 4433 raft_consensus.cc:2781] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:23.893842 4433 raft_consensus.cc:482] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:23.893864 4433 raft_consensus.cc:3037] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:23.894521 4433 raft_consensus.cc:504] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87feaa62486d404681445ed36a2bddf8" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 33141 } } peers { permanent_uuid: "a6417660f0db4da680a22b27e1fb04d0" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34703 } } peers { permanent_uuid: "1aa05d969e4441e2b939cfd925e51410" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 45983 } }
I20260808 07:05:23.894646 4433 leader_election.cc:288] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [CANDIDATE]: Term 1 election: Requested vote from peers 87feaa62486d404681445ed36a2bddf8 (127.29.82.66:33141), a6417660f0db4da680a22b27e1fb04d0 (127.29.82.67:34703)
I20260808 07:05:23.894840 4122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61457d75370446f2ae86aaf18c9524a0" candidate_uuid: "1aa05d969e4441e2b939cfd925e51410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87feaa62486d404681445ed36a2bddf8"
I20260808 07:05:23.894860 4329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61457d75370446f2ae86aaf18c9524a0" candidate_uuid: "1aa05d969e4441e2b939cfd925e51410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6417660f0db4da680a22b27e1fb04d0"
I20260808 07:05:23.894918 4122 raft_consensus.cc:3037] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:23.894935 4329 raft_consensus.cc:3037] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:23.895614 4122 raft_consensus.cc:2454] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1aa05d969e4441e2b939cfd925e51410 in term 1.
I20260808 07:05:23.895607 4329 raft_consensus.cc:2454] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1aa05d969e4441e2b939cfd925e51410 in term 1.
I20260808 07:05:23.895758 3831 leader_election.cc:302] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1aa05d969e4441e2b939cfd925e51410, a6417660f0db4da680a22b27e1fb04d0; no voters:
I20260808 07:05:23.895859 4433 raft_consensus.cc:2781] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:23.896015 4433 raft_consensus.cc:686] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [term 1 LEADER]: Becoming Leader. State: Replica: 1aa05d969e4441e2b939cfd925e51410, State: Running, Role: LEADER
I20260808 07:05:23.896106 4433 consensus_queue.cc:237] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87feaa62486d404681445ed36a2bddf8" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 33141 } } peers { permanent_uuid: "a6417660f0db4da680a22b27e1fb04d0" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34703 } } peers { permanent_uuid: "1aa05d969e4441e2b939cfd925e51410" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 45983 } }
I20260808 07:05:23.896991 3718 catalog_manager.cc:5495] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1aa05d969e4441e2b939cfd925e51410 (127.29.82.65). New cstate: current_term: 1 leader_uuid: "1aa05d969e4441e2b939cfd925e51410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87feaa62486d404681445ed36a2bddf8" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 33141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6417660f0db4da680a22b27e1fb04d0" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1aa05d969e4441e2b939cfd925e51410" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 45983 } health_report { overall_health: HEALTHY } } }
I20260808 07:05:23.914287 4418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.912138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39636 (local address 127.29.82.65:45983)
0808 07:05:23.912199 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:23.912201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:23.912224 (+ 23us) server_negotiation.cc:407] Connection header received
0808 07:05:23.912258 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:23.912259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:23.912277 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:23.912328 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:23.912456 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.912921 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.913665 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:23.913849 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:23.913899 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:23.913998 (+ 99us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:23.914100 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:23.914160 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:23.914172 (+ 12us) server_negotiation.cc:299] Negotiation successful
0808 07:05:23.914189 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:05:23.916244 4329 raft_consensus.cc:1261] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0 [term 1 FOLLOWER]: Refusing update from remote peer 1aa05d969e4441e2b939cfd925e51410: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:23.916244 4122 raft_consensus.cc:1261] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8 [term 1 FOLLOWER]: Refusing update from remote peer 1aa05d969e4441e2b939cfd925e51410: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:23.916589 4439 consensus_queue.cc:1035] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6417660f0db4da680a22b27e1fb04d0" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:23.916728 4433 consensus_queue.cc:1035] T 61457d75370446f2ae86aaf18c9524a0 P 1aa05d969e4441e2b939cfd925e51410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87feaa62486d404681445ed36a2bddf8" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 33141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:23.919041 4443 mvcc.cc:205] Tried to move back new op lower bound from 7316163477158031360 to 7316163477079093248. Current Snapshot: MvccSnapshot[applied={T|T < 7316163477158031360}]
I20260808 07:05:23.919775 4446 mvcc.cc:205] Tried to move back new op lower bound from 7316163477158031360 to 7316163477079093248. Current Snapshot: MvccSnapshot[applied={T|T < 7316163477158031360}]
I20260808 07:05:23.920034 4444 mvcc.cc:205] Tried to move back new op lower bound from 7316163477158031360 to 7316163477079093248. Current Snapshot: MvccSnapshot[applied={T|T < 7316163477158031360}]
I20260808 07:05:23.921389 3718 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:23.921491 3718 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:23.922302 3718 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61b2d0f5bd244754a08c59c190d60702: Sending DeleteTablet for 3 replicas of tablet 61457d75370446f2ae86aaf18c9524a0
I20260808 07:05:23.922659 4292 tablet_service.cc:1514] Processing DeleteTablet for tablet 61457d75370446f2ae86aaf18c9524a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:23 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:37992
I20260808 07:05:23.922659 4096 tablet_service.cc:1514] Processing DeleteTablet for tablet 61457d75370446f2ae86aaf18c9524a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:23 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:57974
I20260808 07:05:23.922883 3896 tablet_service.cc:1514] Processing DeleteTablet for tablet 61457d75370446f2ae86aaf18c9524a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:23 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:39626
I20260808 07:05:23.923002 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 3809
I20260808 07:05:23.930967 4457 tablet_replica.cc:330] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8: stopping tablet replica
I20260808 07:05:23.931103 4457 raft_consensus.cc:2229] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:23.931205 4457 raft_consensus.cc:2258] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:23.931399 4456 tablet_replica.cc:330] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0: stopping tablet replica
I20260808 07:05:23.931492 4456 raft_consensus.cc:2229] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:23.931583 4456 raft_consensus.cc:2258] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:23.931766 4457 ts_tablet_manager.cc:1905] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:23.931984 4456 ts_tablet_manager.cc:1905] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:23.933475 4456 ts_tablet_manager.cc:1918] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:23.933475 4457 ts_tablet_manager.cc:1918] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:23.933558 4456 log.cc:1196] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/61457d75370446f2ae86aaf18c9524a0
I20260808 07:05:23.933558 4457 log.cc:1196] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/61457d75370446f2ae86aaf18c9524a0
I20260808 07:05:23.933840 4457 ts_tablet_manager.cc:1939] T 61457d75370446f2ae86aaf18c9524a0 P 87feaa62486d404681445ed36a2bddf8: Deleting consensus metadata
I20260808 07:05:23.933856 4456 ts_tablet_manager.cc:1939] T 61457d75370446f2ae86aaf18c9524a0 P a6417660f0db4da680a22b27e1fb04d0: Deleting consensus metadata
I20260808 07:05:23.934317 3691 catalog_manager.cc:4841] TS 87feaa62486d404681445ed36a2bddf8 (127.29.82.66:33141): tablet 61457d75370446f2ae86aaf18c9524a0 (table test-table [id=2bd40a8f3152459a9c91dd2842a27047]) successfully deleted
I20260808 07:05:23.934420 3691 catalog_manager.cc:4841] TS a6417660f0db4da680a22b27e1fb04d0 (127.29.82.67:34703): tablet 61457d75370446f2ae86aaf18c9524a0 (table test-table [id=2bd40a8f3152459a9c91dd2842a27047]) successfully deleted
W20260808 07:05:23.939317 3697 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:45983 (error 108)
I20260808 07:05:23.939666 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 4003
I20260808 07:05:23.943974 4415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.939786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:45983 (local address 127.0.0.1:39650)
0808 07:05:23.943871 (+ 4085us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:23.943933 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:45983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4055}
W20260808 07:05:23.944175 3697 catalog_manager.cc:4584] TS 1aa05d969e4441e2b939cfd925e51410 (127.29.82.65:45983): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 61457d75370446f2ae86aaf18c9524a0: Network error: Client connection negotiation failed: client connection to 127.29.82.65:45983: connect: Connection refused (error 111)
I20260808 07:05:23.948974 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 4194
I20260808 07:05:23.958525 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 3668
2026-08-08T07:05:23Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2123 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T07:05:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:23Z Disabled control of system clock
I20260808 07:05:23.989655 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:45751
--webserver_interface=127.29.82.126
--webserver_port=0
--builtin_ntp_servers=127.29.82.84:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:45751
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 07:05:24.071362 4467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:24.071581 4467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:24.071601 4467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:24.072703 4467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:24.072736 4467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:24.072746 4467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:24.072757 4467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:24.072767 4467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:24.074119 4467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:45751
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:45751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:24.074328 4467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:24.074597 4467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:24.079447 4480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:24.079447 4476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:24.079455 4478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:24.079698 4467 server_base.cc:1034] running on GCE node
I20260808 07:05:24.079911 4467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:24.080174 4467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:24.081312 4467 hybrid_clock.cc:648] HybridClock initialized: now 1786172724081298 us; error 28 us; skew 500 ppm
I20260808 07:05:24.082571 4467 webserver.cc:460] Webserver started at http://127.29.82.126:44391/ using document root <none> and password file <none>
I20260808 07:05:24.082819 4467 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:24.082867 4467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:24.082998 4467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:24.084064 4467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "a90853a707e14e6abd5499a6b2495aec"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "fec119334ce1cda0c929ddddf8ed4a9b"
server_key_iv: "bd519169272699bb954b3c801a718d0a"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.084395 4467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "a90853a707e14e6abd5499a6b2495aec"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "fec119334ce1cda0c929ddddf8ed4a9b"
server_key_iv: "bd519169272699bb954b3c801a718d0a"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.085749 4467 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:24.086443 4487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:24.086608 4467 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:24.086691 4467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "a90853a707e14e6abd5499a6b2495aec"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "fec119334ce1cda0c929ddddf8ed4a9b"
server_key_iv: "bd519169272699bb954b3c801a718d0a"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.086762 4467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:24.090178 4467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:24.090441 4467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:24.090560 4467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:24.094317 4467 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:45751
I20260808 07:05:24.094349 4560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:45751 every 8 connection(s)
I20260808 07:05:24.094671 4467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:24.095343 4561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:24.098117 4561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec: Bootstrap starting.
I20260808 07:05:24.098675 4561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:24.098939 4561 log.cc:824] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:24.099599 4561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec: No bootstrap required, opened a new log
I20260808 07:05:24.101190 4561 raft_consensus.cc:348] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a90853a707e14e6abd5499a6b2495aec" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45751 } }
I20260808 07:05:24.101337 4561 raft_consensus.cc:374] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:24.101361 4561 raft_consensus.cc:729] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a90853a707e14e6abd5499a6b2495aec, State: Initialized, Role: FOLLOWER
I20260808 07:05:24.101507 4561 consensus_queue.cc:260] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a90853a707e14e6abd5499a6b2495aec" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45751 } }
I20260808 07:05:24.101589 4561 raft_consensus.cc:388] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:24.101625 4561 raft_consensus.cc:482] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:24.101672 4561 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:24.102218 4561 raft_consensus.cc:504] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a90853a707e14e6abd5499a6b2495aec" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45751 } }
I20260808 07:05:24.102314 4561 leader_election.cc:302] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a90853a707e14e6abd5499a6b2495aec; no voters:
I20260808 07:05:24.102475 4561 leader_election.cc:288] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:24.102522 4567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:24.102689 4567 raft_consensus.cc:686] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [term 1 LEADER]: Becoming Leader. State: Replica: a90853a707e14e6abd5499a6b2495aec, State: Running, Role: LEADER
I20260808 07:05:24.102732 4561 sys_catalog.cc:564] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:24.102785 4567 consensus_queue.cc:237] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a90853a707e14e6abd5499a6b2495aec" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45751 } }
I20260808 07:05:24.103191 4569 sys_catalog.cc:455] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [sys.catalog]: SysCatalogTable state changed. Reason: New leader a90853a707e14e6abd5499a6b2495aec. Latest consensus state: current_term: 1 leader_uuid: "a90853a707e14e6abd5499a6b2495aec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a90853a707e14e6abd5499a6b2495aec" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45751 } } }
I20260808 07:05:24.103276 4569 sys_catalog.cc:458] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:24.103399 4568 sys_catalog.cc:455] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a90853a707e14e6abd5499a6b2495aec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a90853a707e14e6abd5499a6b2495aec" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45751 } } }
I20260808 07:05:24.103500 4584 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:24.104035 4584 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:24.104053 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 4467
I20260808 07:05:24.104137 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:24.104331 30025 external_mini_cluster.cc:1428] Setting key d4eb331966cbe78ae303f7f7d2c760b1
I20260808 07:05:24.103483 4568 sys_catalog.cc:458] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:24.105686 4584 catalog_manager.cc:1347] Generated new cluster ID: 1b210045f03d45528e54bba534e1a9ea
I20260808 07:05:24.105739 4584 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:24.111106 4597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.104969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48714 (local address 127.29.82.126:45751)
0808 07:05:24.105181 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:24.105190 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:24.109480 (+ 4290us) server_negotiation.cc:407] Connection header received
0808 07:05:24.109649 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:24.109658 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:24.109710 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:24.109887 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:24.110587 (+ 700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:24.110592 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:24.110592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:24.110597 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:24.110645 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:24.110661 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:24.110745 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:24.110813 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 07:05:24.110885 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":77,"threads_started":1}
I20260808 07:05:24.127560 4584 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:24.127779 4584 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:24.139798 4584 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec: Generated new TSK 0
I20260808 07:05:24.140012 4584 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:24.149490 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45751
--builtin_ntp_servers=127.29.82.84:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 07:05:24.258742 4599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:24.258956 4599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:24.258978 4599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:24.260106 4599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:24.260139 4599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:24.260162 4599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:05:24.261474 4599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:24.261678 4599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:24.261932 4599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:24.266746 4609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:24.266783 4607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:24.266908 4599 server_base.cc:1034] running on GCE node
W20260808 07:05:24.266741 4606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:24.267225 4599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:24.267454 4599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:24.268594 4599 hybrid_clock.cc:648] HybridClock initialized: now 1786172724268579 us; error 28 us; skew 500 ppm
I20260808 07:05:24.269809 4599 webserver.cc:460] Webserver started at http://127.29.82.65:39267/ using document root <none> and password file <none>
I20260808 07:05:24.270041 4599 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:24.270102 4599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:24.270233 4599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:24.271263 4599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "3aaa2520782a45d59d96f28ea83db2aa"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "8ac504fc8ffd1fd81d3625061ff16063"
server_key_iv: "cb014e869978fae05022035a452196a3"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.271595 4599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "3aaa2520782a45d59d96f28ea83db2aa"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "8ac504fc8ffd1fd81d3625061ff16063"
server_key_iv: "cb014e869978fae05022035a452196a3"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.272838 4599 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:24.273571 4618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:24.273713 4599 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:24.273798 4599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "3aaa2520782a45d59d96f28ea83db2aa"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "8ac504fc8ffd1fd81d3625061ff16063"
server_key_iv: "cb014e869978fae05022035a452196a3"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.273854 4599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:24.277318 4599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:24.277571 4599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:24.277704 4599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:24.277894 4599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:24.278190 4599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:24.278223 4599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:24.278251 4599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:24.278275 4599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:24.283829 4599 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:34847
I20260808 07:05:24.283890 4792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:34847 every 8 connection(s)
I20260808 07:05:24.284190 4599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:05:24.286028 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 4599
I20260808 07:05:24.286115 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:24.286301 30025 external_mini_cluster.cc:1428] Setting key a0ef2ed6a5d735f2371c0f2c35db4a49
I20260808 07:05:24.287321 4597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.284914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:37045 (local address 127.29.82.126:45751)
0808 07:05:24.284982 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:24.284984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:24.285203 (+ 219us) server_negotiation.cc:407] Connection header received
0808 07:05:24.285755 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:24.285757 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:24.285768 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:24.285820 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:24.287099 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:24.287101 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:24.287101 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:24.287105 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:24.287122 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:24.287126 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:24.287166 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:24.287257 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 07:05:24.287269 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 07:05:24.287384 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45751
--builtin_ntp_servers=127.29.82.84:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 07:05:24.287699 4795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.284905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45751 (local address 127.29.82.65:37045)
0808 07:05:24.285077 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:24.285109 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:24.285646 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:24.285912 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:24.285916 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:24.285924 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:24.286943 (+ 1019us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:24.286944 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:24.286983 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:24.287013 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:24.287178 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:24.287183 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:24.287186 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:24.287268 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 07:05:24.287333 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":75,"threads_started":1}
I20260808 07:05:24.288242 4793 heartbeater.cc:347] Connected to a master server at 127.29.82.126:45751
I20260808 07:05:24.288337 4793 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:24.288483 4793 heartbeater.cc:511] Master 127.29.82.126:45751 requested a full tablet report, sending...
I20260808 07:05:24.288997 4516 ts_manager.cc:194] Registered new tserver with Master: 3aaa2520782a45d59d96f28ea83db2aa (127.29.82.65:34847)
W20260808 07:05:24.370579 4796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:24.370786 4796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:24.370808 4796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:24.371964 4796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:24.372004 4796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:24.372031 4796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:05:24.373414 4796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:24.373646 4796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:24.373919 4796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:24.380391 4804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:24.380336 4806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:24.381022 4803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:24.386137 4796 server_base.cc:1034] running on GCE node
I20260808 07:05:24.386405 4796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:24.386708 4796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:24.387859 4796 hybrid_clock.cc:648] HybridClock initialized: now 1786172724387844 us; error 34 us; skew 500 ppm
I20260808 07:05:24.389002 4796 webserver.cc:460] Webserver started at http://127.29.82.66:43815/ using document root <none> and password file <none>
I20260808 07:05:24.389240 4796 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:24.389286 4796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:24.389384 4796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:24.390470 4796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "219b7a96774748b2b74c1eeabd4b2f49"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "74c2416f10af6da626ce9cc37e4ba954"
server_key_iv: "d0551861c9b24e7735580d669bd0cf5e"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.390799 4796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "219b7a96774748b2b74c1eeabd4b2f49"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "74c2416f10af6da626ce9cc37e4ba954"
server_key_iv: "d0551861c9b24e7735580d669bd0cf5e"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.392020 4796 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:24.392653 4816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:24.392802 4796 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:24.392889 4796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "219b7a96774748b2b74c1eeabd4b2f49"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "74c2416f10af6da626ce9cc37e4ba954"
server_key_iv: "d0551861c9b24e7735580d669bd0cf5e"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.392951 4796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:24.396245 4796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:24.396494 4796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:24.396625 4796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:24.396821 4796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:24.397110 4796 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:24.397142 4796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:24.397187 4796 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:24.397204 4796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:24.402680 4796 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:44155
I20260808 07:05:24.402729 4993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:44155 every 8 connection(s)
I20260808 07:05:24.403040 4796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:05:24.405968 4597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.403825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:49871 (local address 127.29.82.126:45751)
0808 07:05:24.403888 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:24.403890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:24.404126 (+ 236us) server_negotiation.cc:407] Connection header received
0808 07:05:24.404601 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:24.404603 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:24.404609 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:24.404668 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:24.405765 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:24.405767 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:24.405767 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:24.405771 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:24.405788 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:24.405792 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:24.405839 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:24.405889 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 07:05:24.405901 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:05:24.406124 4999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.403819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45751 (local address 127.29.82.66:49871)
0808 07:05:24.404001 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:24.404040 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:24.404516 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:24.404722 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:24.404726 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:24.404734 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:24.405623 (+ 889us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:24.405623 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:24.405653 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:24.405682 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:24.405836 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:24.405839 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:24.405841 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:05:24.405891 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 07:05:24.405939 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":73,"threads_started":1}
I20260808 07:05:24.406651 4994 heartbeater.cc:347] Connected to a master server at 127.29.82.126:45751
I20260808 07:05:24.406742 4994 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:24.406893 4994 heartbeater.cc:511] Master 127.29.82.126:45751 requested a full tablet report, sending...
I20260808 07:05:24.407235 4516 ts_manager.cc:194] Registered new tserver with Master: 219b7a96774748b2b74c1eeabd4b2f49 (127.29.82.66:44155)
I20260808 07:05:24.413287 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 4796
I20260808 07:05:24.413388 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:24.413585 30025 external_mini_cluster.cc:1428] Setting key 5ee86b453a85478c0ce4b6e95461837e
I20260808 07:05:24.414508 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45751
--builtin_ntp_servers=127.29.82.84:42429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 07:05:24.495818 5000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:24.496022 5000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:24.496043 5000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:24.497234 5000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:24.497273 5000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:24.497298 5000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:05:24.498610 5000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:42429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:24.498808 5000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:24.499066 5000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:24.503980 5006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:24.504081 5007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:24.504096 5000 server_base.cc:1034] running on GCE node
W20260808 07:05:24.503980 5011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:24.504392 5000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:24.504714 5000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:24.505851 5000 hybrid_clock.cc:648] HybridClock initialized: now 1786172724505837 us; error 30 us; skew 500 ppm
I20260808 07:05:24.507042 5000 webserver.cc:460] Webserver started at http://127.29.82.67:38437/ using document root <none> and password file <none>
I20260808 07:05:24.507282 5000 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:24.507331 5000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:24.507462 5000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:24.508512 5000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "d6f5f0397fdf465eb0045716f7b16144"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "7c1e24c13aec76157140060983d7ca55"
server_key_iv: "5df924c331a1220d55319c96ea7d839f"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.508850 5000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "d6f5f0397fdf465eb0045716f7b16144"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "7c1e24c13aec76157140060983d7ca55"
server_key_iv: "5df924c331a1220d55319c96ea7d839f"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.510147 5000 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:24.510812 5020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:24.510962 5000 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:24.511046 5000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "d6f5f0397fdf465eb0045716f7b16144"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "7c1e24c13aec76157140060983d7ca55"
server_key_iv: "5df924c331a1220d55319c96ea7d839f"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.511106 5000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:24.514441 5000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:24.514698 5000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:24.514812 5000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:24.514992 5000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:24.515273 5000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:24.515305 5000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:24.515331 5000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:24.515348 5000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:24.520728 5000 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:40701
I20260808 07:05:24.520785 5193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:40701 every 8 connection(s)
I20260808 07:05:24.521093 5000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:05:24.524012 4597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.521835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:36999 (local address 127.29.82.126:45751)
0808 07:05:24.521891 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:24.521893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:24.522097 (+ 204us) server_negotiation.cc:407] Connection header received
0808 07:05:24.522593 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:24.522595 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:24.522603 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:24.522656 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:24.523753 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:24.523755 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:24.523755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:24.523760 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:24.523777 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:24.523781 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:24.523836 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:24.523914 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 07:05:24.523929 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:05:24.524201 5196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.521802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45751 (local address 127.29.82.67:36999)
0808 07:05:24.521974 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:24.522015 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:24.522480 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:24.522729 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:24.522734 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:24.522744 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:24.523601 (+ 857us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:24.523602 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:24.523630 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:24.523660 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:24.523838 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:24.523844 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:24.523847 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:24.523919 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 07:05:24.523999 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":66,"threads_started":1}
I20260808 07:05:24.524659 5194 heartbeater.cc:347] Connected to a master server at 127.29.82.126:45751
I20260808 07:05:24.524742 5194 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:24.524886 5194 heartbeater.cc:511] Master 127.29.82.126:45751 requested a full tablet report, sending...
I20260808 07:05:24.525260 4516 ts_manager.cc:194] Registered new tserver with Master: d6f5f0397fdf465eb0045716f7b16144 (127.29.82.67:40701)
I20260808 07:05:24.529933 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 5000
I20260808 07:05:24.530043 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:24.530224 30025 external_mini_cluster.cc:1428] Setting key 56340eeb10c65c3f5b6a2c23a9fde07f
I20260808 07:05:24.531134 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:05:24.533427 4597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.532416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48728 (local address 127.29.82.126:45751)
0808 07:05:24.532463 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:24.532464 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:24.532562 (+ 98us) server_negotiation.cc:407] Connection header received
0808 07:05:24.532608 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:24.532609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:24.532625 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:24.532675 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:24.533219 (+ 544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:24.533221 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:24.533221 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:24.533226 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:24.533244 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:24.533249 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:24.533296 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:24.533337 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 07:05:24.533352 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:05:24.534904 4516 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:24.536367 4516 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:24.540030 5204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.538435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:40701 (local address 127.0.0.1:46772)
0808 07:05:24.538607 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:24.538647 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:24.538704 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:24.539159 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:24.539160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:24.539163 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:24.539535 (+ 372us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:24.539535 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:24.539552 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:24.539575 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:24.539876 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:24.539883 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:24.539887 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:24.539945 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:05:24.539958 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":65,"threads_started":1}
I20260808 07:05:24.540045 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.538810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46772 (local address 127.29.82.67:40701)
0808 07:05:24.538963 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:24.538968 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:24.538979 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:05:24.539006 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:24.539009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:24.539018 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:24.539327 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:24.539775 (+ 448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:24.539780 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:24.539781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:24.539784 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:24.539814 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:24.539830 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:24.539884 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:24.539952 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 07:05:24.539965 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
I20260808 07:05:24.540225 5213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.538688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49546 (local address 127.29.82.65:34847)
0808 07:05:24.538852 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:24.538857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:24.538871 (+ 14us) server_negotiation.cc:407] Connection header received
0808 07:05:24.538896 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:24.538898 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:24.538908 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:24.538972 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:24.539871 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:24.539878 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:24.539878 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:24.539882 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:24.539913 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:24.539937 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:24.539990 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:24.540126 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 07:05:24.540142 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":79,"threads_started":1}
I20260808 07:05:24.540257 5205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.538446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:34847 (local address 127.0.0.1:49546)
0808 07:05:24.538782 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:24.538790 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:24.538821 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:24.538980 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:24.538988 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:24.538994 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:24.539776 (+ 782us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:24.539776 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:24.539783 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:24.539793 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:24.540016 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:24.540017 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:24.540018 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:05:24.540062 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:05:24.540075 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":104,"threads_started":1}
I20260808 07:05:24.540329 5207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.538633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40814 (local address 127.29.82.66:44155)
0808 07:05:24.538991 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:24.538994 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:24.539002 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:24.539024 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:24.539026 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:24.539034 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:24.539111 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:24.539859 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:24.539868 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:24.539868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:24.539873 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:24.539913 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:24.539937 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:24.539990 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:24.540236 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 07:05:24.540253 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":79,"threads_started":1}
I20260808 07:05:24.540454 5206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.538435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:44155 (local address 127.0.0.1:40814)
0808 07:05:24.538618 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:24.538647 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:24.538705 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:24.539429 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:24.539430 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:24.539433 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:24.539758 (+ 325us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:24.539759 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:24.539765 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:24.539775 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:24.540016 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:24.540017 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:24.540018 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:05:24.540071 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 07:05:24.540081 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":2,"thread_start_us":85,"threads_started":1}
I20260808 07:05:24.540935 4691 tablet_service.cc:1467] Processing CreateTablet for tablet 4e0ddfae35d144019f8287cc1071f1f5 (DEFAULT_TABLE table=test-table [id=d5ec4c27cec046d1837c0bf3d580523d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:24.541090 4893 tablet_service.cc:1467] Processing CreateTablet for tablet 4e0ddfae35d144019f8287cc1071f1f5 (DEFAULT_TABLE table=test-table [id=d5ec4c27cec046d1837c0bf3d580523d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:24.541213 5093 tablet_service.cc:1467] Processing CreateTablet for tablet 4e0ddfae35d144019f8287cc1071f1f5 (DEFAULT_TABLE table=test-table [id=d5ec4c27cec046d1837c0bf3d580523d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:24.541343 4691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e0ddfae35d144019f8287cc1071f1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:24.541467 4893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e0ddfae35d144019f8287cc1071f1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:24.541524 5093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e0ddfae35d144019f8287cc1071f1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:24.543861 5215 tablet_bootstrap.cc:492] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49: Bootstrap starting.
I20260808 07:05:24.544593 5215 tablet_bootstrap.cc:654] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:24.544561 5217 tablet_bootstrap.cc:492] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144: Bootstrap starting.
I20260808 07:05:24.544986 5215 log.cc:824] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:24.545249 5217 tablet_bootstrap.cc:654] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:24.545336 5218 tablet_bootstrap.cc:492] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa: Bootstrap starting.
I20260808 07:05:24.545563 5217 log.cc:824] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:24.545830 5215 tablet_bootstrap.cc:492] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49: No bootstrap required, opened a new log
I20260808 07:05:24.545897 5215 ts_tablet_manager.cc:1397] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:24.545969 5218 tablet_bootstrap.cc:654] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:24.546244 5218 log.cc:824] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:24.546327 5217 tablet_bootstrap.cc:492] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144: No bootstrap required, opened a new log
I20260808 07:05:24.546394 5217 ts_tablet_manager.cc:1397] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:05:24.546869 5218 tablet_bootstrap.cc:492] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa: No bootstrap required, opened a new log
I20260808 07:05:24.546927 5218 ts_tablet_manager.cc:1397] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:24.548393 5215 raft_consensus.cc:348] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f5f0397fdf465eb0045716f7b16144" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40701 } } peers { permanent_uuid: "219b7a96774748b2b74c1eeabd4b2f49" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44155 } } peers { permanent_uuid: "3aaa2520782a45d59d96f28ea83db2aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 34847 } }
I20260808 07:05:24.548578 5215 raft_consensus.cc:374] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:24.548614 5215 raft_consensus.cc:729] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 219b7a96774748b2b74c1eeabd4b2f49, State: Initialized, Role: FOLLOWER
I20260808 07:05:24.548738 5215 consensus_queue.cc:260] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f5f0397fdf465eb0045716f7b16144" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40701 } } peers { permanent_uuid: "219b7a96774748b2b74c1eeabd4b2f49" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44155 } } peers { permanent_uuid: "3aaa2520782a45d59d96f28ea83db2aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 34847 } }
I20260808 07:05:24.548827 5217 raft_consensus.cc:348] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f5f0397fdf465eb0045716f7b16144" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40701 } } peers { permanent_uuid: "219b7a96774748b2b74c1eeabd4b2f49" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44155 } } peers { permanent_uuid: "3aaa2520782a45d59d96f28ea83db2aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 34847 } }
I20260808 07:05:24.548975 5217 raft_consensus.cc:374] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:24.549006 5215 ts_tablet_manager.cc:1428] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:05:24.549015 5217 raft_consensus.cc:729] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6f5f0397fdf465eb0045716f7b16144, State: Initialized, Role: FOLLOWER
I20260808 07:05:24.548904 5218 raft_consensus.cc:348] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f5f0397fdf465eb0045716f7b16144" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40701 } } peers { permanent_uuid: "219b7a96774748b2b74c1eeabd4b2f49" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44155 } } peers { permanent_uuid: "3aaa2520782a45d59d96f28ea83db2aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 34847 } }
I20260808 07:05:24.549052 5218 raft_consensus.cc:374] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:24.549171 4994 heartbeater.cc:503] Master 127.29.82.126:45751 was elected leader, sending a full tablet report...
I20260808 07:05:24.549122 5217 consensus_queue.cc:260] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f5f0397fdf465eb0045716f7b16144" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40701 } } peers { permanent_uuid: "219b7a96774748b2b74c1eeabd4b2f49" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44155 } } peers { permanent_uuid: "3aaa2520782a45d59d96f28ea83db2aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 34847 } }
I20260808 07:05:24.549139 5218 raft_consensus.cc:729] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3aaa2520782a45d59d96f28ea83db2aa, State: Initialized, Role: FOLLOWER
I20260808 07:05:24.549291 5218 consensus_queue.cc:260] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f5f0397fdf465eb0045716f7b16144" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40701 } } peers { permanent_uuid: "219b7a96774748b2b74c1eeabd4b2f49" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44155 } } peers { permanent_uuid: "3aaa2520782a45d59d96f28ea83db2aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 34847 } }
I20260808 07:05:24.549379 5217 ts_tablet_manager.cc:1428] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 07:05:24.549480 5194 heartbeater.cc:503] Master 127.29.82.126:45751 was elected leader, sending a full tablet report...
I20260808 07:05:24.549536 5218 ts_tablet_manager.cc:1428] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 07:05:24.549647 4793 heartbeater.cc:503] Master 127.29.82.126:45751 was elected leader, sending a full tablet report...
W20260808 07:05:24.653582 4997 tablet.cc:2369] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:24.726147 5224 raft_consensus.cc:482] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:24.726296 5224 raft_consensus.cc:504] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f5f0397fdf465eb0045716f7b16144" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40701 } } peers { permanent_uuid: "219b7a96774748b2b74c1eeabd4b2f49" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44155 } } peers { permanent_uuid: "3aaa2520782a45d59d96f28ea83db2aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 34847 } }
I20260808 07:05:24.726720 5224 leader_election.cc:288] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6f5f0397fdf465eb0045716f7b16144 (127.29.82.67:40701), 3aaa2520782a45d59d96f28ea83db2aa (127.29.82.65:34847)
I20260808 07:05:24.730995 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.726972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:48977 (local address 127.29.82.67:40701)
0808 07:05:24.727024 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:24.727026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:24.727058 (+ 32us) server_negotiation.cc:407] Connection header received
0808 07:05:24.727083 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:24.727084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:24.727090 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:24.727130 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:24.730743 (+ 3613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:24.730745 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:24.730745 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:24.730752 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:24.730774 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:24.730779 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:24.730837 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:24.730904 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 07:05:24.730918 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 07:05:24.730995 5213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.727209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:56479 (local address 127.29.82.65:34847)
0808 07:05:24.727267 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:24.727269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:24.727277 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:24.727305 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:24.727305 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:24.727310 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:24.727366 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:24.730743 (+ 3377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:24.730745 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:24.730745 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:24.730752 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:24.730774 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:24.730780 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:24.730837 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:24.730904 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 07:05:24.730918 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:05:24.731006 4999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.726889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:40701 (local address 127.29.82.66:48977)
0808 07:05:24.726949 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:24.726963 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:24.727019 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:24.727139 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:24.727140 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:24.727142 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:24.730591 (+ 3449us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:24.730592 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:24.730611 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:24.730629 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:24.730850 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:24.730851 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:24.730852 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:05:24.730898 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:05:24.730930 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":16}
I20260808 07:05:24.731040 5227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.726890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:34847 (local address 127.29.82.66:56479)
0808 07:05:24.727055 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:24.727064 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:24.727102 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:24.727377 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:24.727378 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:24.727380 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:24.730591 (+ 3211us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:24.730592 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:24.730609 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:24.730629 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:24.730850 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:24.730851 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:24.730852 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:05:24.730899 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:05:24.730924 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":13,"thread_start_us":100,"threads_started":1}
I20260808 07:05:24.731379 5123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0ddfae35d144019f8287cc1071f1f5" candidate_uuid: "219b7a96774748b2b74c1eeabd4b2f49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6f5f0397fdf465eb0045716f7b16144" is_pre_election: true
I20260808 07:05:24.731559 5123 raft_consensus.cc:2454] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 219b7a96774748b2b74c1eeabd4b2f49 in term 0.
I20260808 07:05:24.731631 4724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0ddfae35d144019f8287cc1071f1f5" candidate_uuid: "219b7a96774748b2b74c1eeabd4b2f49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3aaa2520782a45d59d96f28ea83db2aa" is_pre_election: true
I20260808 07:05:24.731782 4724 raft_consensus.cc:2454] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 219b7a96774748b2b74c1eeabd4b2f49 in term 0.
I20260808 07:05:24.731841 4821 leader_election.cc:302] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 219b7a96774748b2b74c1eeabd4b2f49, d6f5f0397fdf465eb0045716f7b16144; no voters:
I20260808 07:05:24.731971 5224 raft_consensus.cc:2781] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:24.732028 5224 raft_consensus.cc:482] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:24.732056 5224 raft_consensus.cc:3037] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:24.732846 5224 raft_consensus.cc:504] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f5f0397fdf465eb0045716f7b16144" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40701 } } peers { permanent_uuid: "219b7a96774748b2b74c1eeabd4b2f49" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44155 } } peers { permanent_uuid: "3aaa2520782a45d59d96f28ea83db2aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 34847 } }
I20260808 07:05:24.732985 5224 leader_election.cc:288] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [CANDIDATE]: Term 1 election: Requested vote from peers d6f5f0397fdf465eb0045716f7b16144 (127.29.82.67:40701), 3aaa2520782a45d59d96f28ea83db2aa (127.29.82.65:34847)
I20260808 07:05:24.733134 4724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0ddfae35d144019f8287cc1071f1f5" candidate_uuid: "219b7a96774748b2b74c1eeabd4b2f49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3aaa2520782a45d59d96f28ea83db2aa"
I20260808 07:05:24.733238 4724 raft_consensus.cc:3037] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:24.733224 5123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0ddfae35d144019f8287cc1071f1f5" candidate_uuid: "219b7a96774748b2b74c1eeabd4b2f49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6f5f0397fdf465eb0045716f7b16144"
I20260808 07:05:24.733309 5123 raft_consensus.cc:3037] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:24.733970 4724 raft_consensus.cc:2454] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 219b7a96774748b2b74c1eeabd4b2f49 in term 1.
I20260808 07:05:24.734066 5123 raft_consensus.cc:2454] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 219b7a96774748b2b74c1eeabd4b2f49 in term 1.
I20260808 07:05:24.734169 4819 leader_election.cc:302] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 219b7a96774748b2b74c1eeabd4b2f49, 3aaa2520782a45d59d96f28ea83db2aa; no voters:
I20260808 07:05:24.734261 5224 raft_consensus.cc:2781] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:24.734405 5224 raft_consensus.cc:686] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [term 1 LEADER]: Becoming Leader. State: Replica: 219b7a96774748b2b74c1eeabd4b2f49, State: Running, Role: LEADER
I20260808 07:05:24.734503 5224 consensus_queue.cc:237] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f5f0397fdf465eb0045716f7b16144" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40701 } } peers { permanent_uuid: "219b7a96774748b2b74c1eeabd4b2f49" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44155 } } peers { permanent_uuid: "3aaa2520782a45d59d96f28ea83db2aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 34847 } }
I20260808 07:05:24.735352 4515 catalog_manager.cc:5495] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 219b7a96774748b2b74c1eeabd4b2f49 (127.29.82.66). New cstate: current_term: 1 leader_uuid: "219b7a96774748b2b74c1eeabd4b2f49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f5f0397fdf465eb0045716f7b16144" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "219b7a96774748b2b74c1eeabd4b2f49" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3aaa2520782a45d59d96f28ea83db2aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 34847 } health_report { overall_health: UNKNOWN } } }
I20260808 07:05:24.770854 5207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.769965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40824 (local address 127.29.82.66:44155)
0808 07:05:24.770027 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:24.770028 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:24.770036 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:24.770071 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:24.770072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:24.770085 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:24.770132 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:24.770685 (+ 553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:24.770686 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:24.770686 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:24.770689 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:24.770703 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:24.770706 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:24.770750 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:24.770783 (+ 33us) server_negotiation.cc:299] Negotiation successful
0808 07:05:24.770793 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 07:05:24.771623 5195 tablet.cc:2369] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:24.772624 5123 raft_consensus.cc:1261] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144 [term 1 FOLLOWER]: Refusing update from remote peer 219b7a96774748b2b74c1eeabd4b2f49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:24.772624 4724 raft_consensus.cc:1261] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa [term 1 FOLLOWER]: Refusing update from remote peer 219b7a96774748b2b74c1eeabd4b2f49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:24.772950 5228 consensus_queue.cc:1035] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6f5f0397fdf465eb0045716f7b16144" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 40701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:24.773079 5224 consensus_queue.cc:1035] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3aaa2520782a45d59d96f28ea83db2aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:24.775882 5231 mvcc.cc:205] Tried to move back new op lower bound from 7316163480666046464 to 7316163480513155072. Current Snapshot: MvccSnapshot[applied={T|T < 7316163480666046464}]
I20260808 07:05:24.778004 4513 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:24.778102 4513 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:24.778841 4513 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a90853a707e14e6abd5499a6b2495aec: Sending DeleteTablet for 3 replicas of tablet 4e0ddfae35d144019f8287cc1071f1f5
I20260808 07:05:24.779274 5093 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e0ddfae35d144019f8287cc1071f1f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:24 UTC) from {username='slave'} at 127.0.0.1:46772
I20260808 07:05:24.779276 4691 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e0ddfae35d144019f8287cc1071f1f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:24 UTC) from {username='slave'} at 127.0.0.1:49546
I20260808 07:05:24.779491 5247 tablet_replica.cc:330] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa: stopping tablet replica
I20260808 07:05:24.779588 5247 raft_consensus.cc:2229] T 4e0ddfae35d144019f8287cc1071f1f5 P 3aaa2520782a45d59d96f28ea83db2aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:24.779577 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 4599
I20260808 07:05:24.790803 4893 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e0ddfae35d144019f8287cc1071f1f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:24 UTC) from {username='slave'} at 127.0.0.1:40814
I20260808 07:05:24.791196 5246 tablet_replica.cc:330] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144: stopping tablet replica
I20260808 07:05:24.791339 5246 raft_consensus.cc:2229] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:24.791473 5246 raft_consensus.cc:2258] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:24.792037 5246 ts_tablet_manager.cc:1905] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:24.793893 5246 ts_tablet_manager.cc:1918] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:24.793978 5246 log.cc:1196] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/4e0ddfae35d144019f8287cc1071f1f5
I20260808 07:05:24.794260 5246 ts_tablet_manager.cc:1939] T 4e0ddfae35d144019f8287cc1071f1f5 P d6f5f0397fdf465eb0045716f7b16144: Deleting consensus metadata
I20260808 07:05:24.794821 5248 tablet_replica.cc:330] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49: stopping tablet replica
W20260808 07:05:24.794852 4491 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:34847 (error 108)
I20260808 07:05:24.794947 5248 raft_consensus.cc:2229] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:05:24.795158 5248 raft_consensus.cc:2258] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:24.795254 4493 catalog_manager.cc:4841] TS d6f5f0397fdf465eb0045716f7b16144 (127.29.82.67:40701): tablet 4e0ddfae35d144019f8287cc1071f1f5 (table test-table [id=d5ec4c27cec046d1837c0bf3d580523d]) successfully deleted
I20260808 07:05:24.795440 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 4796
I20260808 07:05:24.795642 5248 ts_tablet_manager.cc:1905] T 4e0ddfae35d144019f8287cc1071f1f5 P 219b7a96774748b2b74c1eeabd4b2f49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:24.804098 5206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.803901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:34847 (local address 127.0.0.1:49554)
0808 07:05:24.803957 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:24.804052 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:34847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 07:05:24.804267 4491 catalog_manager.cc:4584] TS 3aaa2520782a45d59d96f28ea83db2aa (127.29.82.65:34847): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4e0ddfae35d144019f8287cc1071f1f5: Network error: Client connection negotiation failed: client connection to 127.29.82.65:34847: connect: Connection refused (error 111)
I20260808 07:05:24.808005 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 5000
I20260808 07:05:24.808043 5206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.807920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:44155 (local address 127.0.0.1:40834)
0808 07:05:24.807971 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:24.808008 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.66:44155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 07:05:24.816431 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 4467
2026-08-08T07:05:24Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (863 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 07:05:24.845266 30025 mini_oidc.cc:152] Starting JWKS server
I20260808 07:05:24.846380 30025 webserver.cc:460] Webserver started at https://127.0.0.1:39903/ using document root <none> and password file <none>
I20260808 07:05:24.846458 30025 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 07:05:24.846596 30025 webserver.cc:460] Webserver started at http://127.0.0.1:40447/ using document root <none> and password file <none>
2026-08-08T07:05:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:24Z Disabled control of system clock
I20260808 07:05:24.855300 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:35561
--webserver_interface=127.29.82.126
--webserver_port=0
--builtin_ntp_servers=127.29.82.84:42791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:35561
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39903/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/testchainca.cert with env {}
W20260808 07:05:24.937192 5257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:24.937417 5257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:24.937440 5257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:24.938607 5257 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:24.938642 5257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:24.938653 5257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:24.938664 5257 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:24.938675 5257 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 07:05:24.938686 5257 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 07:05:24.938696 5257 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39903/jwks.json
I20260808 07:05:24.940270 5257 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:42791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:35561
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:35561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39903/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:24.940500 5257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:24.940687 5257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:24.945468 5269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:24.945577 5266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:24.945468 5267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:24.945730 5257 server_base.cc:1034] running on GCE node
I20260808 07:05:24.945976 5257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:24.946267 5257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:24.947412 5257 hybrid_clock.cc:648] HybridClock initialized: now 1786172724947400 us; error 32 us; skew 500 ppm
I20260808 07:05:24.948678 5257 webserver.cc:460] Webserver started at http://127.29.82.126:39765/ using document root <none> and password file <none>
I20260808 07:05:24.948930 5257 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:24.948983 5257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:24.949107 5257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:24.950198 5257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "dc3e54691db34827bdd2ca5b78e2a948"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "7c112997ef82db55f067b9356d8d7a90"
server_key_iv: "2a115c10a02344844146c87b0bf9b6a9"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.950541 5257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "dc3e54691db34827bdd2ca5b78e2a948"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "7c112997ef82db55f067b9356d8d7a90"
server_key_iv: "2a115c10a02344844146c87b0bf9b6a9"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.951810 5257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:24.952486 5275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:24.952662 5257 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:24.952762 5257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "dc3e54691db34827bdd2ca5b78e2a948"
format_stamp: "Formatted at 2026-08-08 07:05:24 on dist-test-slave-rmhg"
server_key: "7c112997ef82db55f067b9356d8d7a90"
server_key_iv: "2a115c10a02344844146c87b0bf9b6a9"
server_key_version: "encryptionkey@0"
I20260808 07:05:24.952826 5257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:24.966763 5257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:24.967096 5257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:24.967235 5257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:24.971061 5257 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:35561
I20260808 07:05:24.971102 5353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:35561 every 8 connection(s)
I20260808 07:05:24.971441 5257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:24.972425 5355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:24.974810 5355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948: Bootstrap starting.
I20260808 07:05:24.975370 5355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:24.975615 5355 log.cc:824] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:24.976336 5355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948: No bootstrap required, opened a new log
I20260808 07:05:24.977970 5355 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc3e54691db34827bdd2ca5b78e2a948" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35561 } }
I20260808 07:05:24.978123 5355 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:24.978150 5355 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3e54691db34827bdd2ca5b78e2a948, State: Initialized, Role: FOLLOWER
I20260808 07:05:24.978260 5355 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc3e54691db34827bdd2ca5b78e2a948" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35561 } }
I20260808 07:05:24.978309 5355 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:24.978335 5355 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:24.978365 5355 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:24.978847 5355 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc3e54691db34827bdd2ca5b78e2a948" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35561 } }
I20260808 07:05:24.978932 5355 leader_election.cc:302] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc3e54691db34827bdd2ca5b78e2a948; no voters:
I20260808 07:05:24.979070 5355 leader_election.cc:288] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:24.979121 5358 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:24.979274 5358 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [term 1 LEADER]: Becoming Leader. State: Replica: dc3e54691db34827bdd2ca5b78e2a948, State: Running, Role: LEADER
I20260808 07:05:24.979331 5355 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:24.979378 5358 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc3e54691db34827bdd2ca5b78e2a948" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35561 } }
I20260808 07:05:24.979791 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 5257
I20260808 07:05:24.979914 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:24.980127 30025 external_mini_cluster.cc:1428] Setting key 563b03bdc5a8f17fda4d931f47a750ba
I20260808 07:05:24.980592 5361 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc3e54691db34827bdd2ca5b78e2a948. Latest consensus state: current_term: 1 leader_uuid: "dc3e54691db34827bdd2ca5b78e2a948" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc3e54691db34827bdd2ca5b78e2a948" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35561 } } }
I20260808 07:05:24.980696 5361 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:24.980824 5360 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc3e54691db34827bdd2ca5b78e2a948" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc3e54691db34827bdd2ca5b78e2a948" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35561 } } }
I20260808 07:05:24.981128 5360 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948 [sys.catalog]: This master's current role is: LEADER
W20260808 07:05:24.981526 5380 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:05:24.981582 5380 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:05:24.981652 5381 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:24.981813 5381 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:24.983160 5381 catalog_manager.cc:1347] Generated new cluster ID: 45f96fc1061348a98841539da1eeb995
I20260808 07:05:24.983208 5381 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:24.986444 5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.980665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48064 (local address 127.29.82.126:35561)
0808 07:05:24.981024 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:24.981076 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:24.981113 (+ 37us) server_negotiation.cc:407] Connection header received
0808 07:05:24.981255 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:24.981263 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:24.981340 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:24.981491 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:24.981799 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:24.983139 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:24.984216 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:24.984880 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:24.985008 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:24.985732 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:24.985737 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:24.985737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:24.985950 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:24.985994 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:24.986009 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:24.986076 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:24.986133 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 07:05:24.986217 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":67,"threads_started":1}
I20260808 07:05:24.987417 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:24.997969 5381 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:24.998528 5381 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:25.013010 5381 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc3e54691db34827bdd2ca5b78e2a948: Generated new TSK 0
I20260808 07:05:25.013288 5381 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 07:05:25.048106 5398 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
I20260808 07:05:25.048353 5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:25.026134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48070 (local address 127.29.82.126:35561)
0808 07:05:25.026192 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:25.026195 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:25.026348 (+ 153us) server_negotiation.cc:407] Connection header received
0808 07:05:25.026466 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:25.026467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:25.026478 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:25.026537 (+ 59us) server_negotiation.cc:226] Negotiated authn=JWT
0808 07:05:25.026705 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.027254 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.028440 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.028663 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.028713 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:25.028944 (+ 231us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 07:05:25.048115 (+ 19171us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39903/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 07:05:25.048281 (+ 166us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48070: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39903/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":30}
E20260808 07:05:25.048373 5398 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260808 07:05:25.048430 5378 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48070: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39903/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 07:05:25.048820 5396 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:05:25.026062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:35561 (local address 127.0.0.1:48070)
0808 07:05:25.026272 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:25.026285 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:25.026367 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:25.026563 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:25.026564 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:25.026567 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0808 07:05:25.026649 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:25.026652 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.027363 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.027364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:25.028348 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:25.028352 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.028742 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.028743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:25.028812 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:25.028840 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 07:05:25.048267 (+ 19427us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39903/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 07:05:25.048406 (+ 139us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.82.126:35561: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39903/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":81,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.29.82.126:35561: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39903/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 07:05:25.049342 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 5257
2026-08-08T07:05:25Z chronyd exiting
I20260808 07:05:25.091403 30025 test_util.cc:175] -----------------------------------------------
I20260808 07:05:25.091490 30025 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172701750152-30025-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (247 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 07:05:25.092305 30025 mini_oidc.cc:152] Starting JWKS server
I20260808 07:05:25.092985 30025 webserver.cc:460] Webserver started at https://127.0.0.1:33667/ using document root <none> and password file <none>
I20260808 07:05:25.093025 30025 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 07:05:25.093181 30025 webserver.cc:460] Webserver started at http://127.0.0.1:46399/ using document root <none> and password file <none>
2026-08-08T07:05:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:25Z Disabled control of system clock
I20260808 07:05:25.101855 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:41201
--webserver_interface=127.29.82.126
--webserver_port=0
--builtin_ntp_servers=127.29.82.84:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:41201
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33667/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/testchainca.cert with env {}
W20260808 07:05:25.183408 5408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:25.183655 5408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:25.183687 5408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:25.184957 5408 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:25.185010 5408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:25.185026 5408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:25.185042 5408 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:25.185058 5408 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 07:05:25.185073 5408 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 07:05:25.185087 5408 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33667/jwks.json
I20260808 07:05:25.186774 5408 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:41201
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:41201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33667/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:25.187054 5408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:25.187268 5408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:25.192129 5417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:25.192134 5416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:25.192179 5419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:25.192378 5408 server_base.cc:1034] running on GCE node
I20260808 07:05:25.192632 5408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:25.192920 5408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:25.194060 5408 hybrid_clock.cc:648] HybridClock initialized: now 1786172725194036 us; error 39 us; skew 500 ppm
I20260808 07:05:25.195258 5408 webserver.cc:460] Webserver started at http://127.29.82.126:38379/ using document root <none> and password file <none>
I20260808 07:05:25.195488 5408 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:25.195540 5408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:25.195690 5408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:25.196794 5408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "bf63765f240845d2ade6b6871c73a9d9"
format_stamp: "Formatted at 2026-08-08 07:05:25 on dist-test-slave-rmhg"
server_key: "2f63addf6e6ddde050ca3881c2048eaf"
server_key_iv: "8ea31929bc3844fe325b7bdcd13a1bc9"
server_key_version: "encryptionkey@0"
I20260808 07:05:25.197144 5408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "bf63765f240845d2ade6b6871c73a9d9"
format_stamp: "Formatted at 2026-08-08 07:05:25 on dist-test-slave-rmhg"
server_key: "2f63addf6e6ddde050ca3881c2048eaf"
server_key_iv: "8ea31929bc3844fe325b7bdcd13a1bc9"
server_key_version: "encryptionkey@0"
I20260808 07:05:25.198421 5408 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:25.199115 5428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:25.199270 5408 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:25.199359 5408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "bf63765f240845d2ade6b6871c73a9d9"
format_stamp: "Formatted at 2026-08-08 07:05:25 on dist-test-slave-rmhg"
server_key: "2f63addf6e6ddde050ca3881c2048eaf"
server_key_iv: "8ea31929bc3844fe325b7bdcd13a1bc9"
server_key_version: "encryptionkey@0"
I20260808 07:05:25.199427 5408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:25.211030 5408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:25.211347 5408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:25.211480 5408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:25.215348 5408 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:41201
I20260808 07:05:25.215381 5506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:41201 every 8 connection(s)
I20260808 07:05:25.215745 5408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:25.216209 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 5408
I20260808 07:05:25.216325 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:25.216524 30025 external_mini_cluster.cc:1428] Setting key 054987f54447f7ca7ae012abe82ea485
I20260808 07:05:25.216601 5507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:25.220090 5507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9: Bootstrap starting.
I20260808 07:05:25.220847 5507 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:25.221176 5507 log.cc:824] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:25.221988 5512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:25.217073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44766 (local address 127.29.82.126:41201)
0808 07:05:25.217287 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:25.217295 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:25.217320 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:05:25.217749 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:25.217756 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:25.217819 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:25.217931 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:25.218155 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.219017 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.220052 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.220492 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.220586 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:25.221327 (+ 741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:25.221332 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:25.221333 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:25.221498 (+ 165us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:25.221530 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:25.221542 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:25.221601 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:25.221697 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 07:05:25.221768 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":101,"threads_started":1}
I20260808 07:05:25.222030 5507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9: No bootstrap required, opened a new log
I20260808 07:05:25.222963 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:25.224236 5507 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf63765f240845d2ade6b6871c73a9d9" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41201 } }
I20260808 07:05:25.224373 5507 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:25.224395 5507 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf63765f240845d2ade6b6871c73a9d9, State: Initialized, Role: FOLLOWER
I20260808 07:05:25.224504 5507 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf63765f240845d2ade6b6871c73a9d9" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41201 } }
I20260808 07:05:25.224578 5507 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:25.224604 5507 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:25.224644 5507 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:25.225147 5507 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf63765f240845d2ade6b6871c73a9d9" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41201 } }
I20260808 07:05:25.225279 5507 leader_election.cc:302] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf63765f240845d2ade6b6871c73a9d9; no voters:
I20260808 07:05:25.225443 5507 leader_election.cc:288] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:25.225513 5514 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:25.225636 5514 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [term 1 LEADER]: Becoming Leader. State: Replica: bf63765f240845d2ade6b6871c73a9d9, State: Running, Role: LEADER
I20260808 07:05:25.225721 5507 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:25.225716 5514 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf63765f240845d2ade6b6871c73a9d9" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41201 } }
I20260808 07:05:25.226209 5515 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf63765f240845d2ade6b6871c73a9d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf63765f240845d2ade6b6871c73a9d9" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41201 } } }
I20260808 07:05:25.226213 5516 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf63765f240845d2ade6b6871c73a9d9. Latest consensus state: current_term: 1 leader_uuid: "bf63765f240845d2ade6b6871c73a9d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf63765f240845d2ade6b6871c73a9d9" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41201 } } }
I20260808 07:05:25.226349 5515 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:25.226382 5516 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:25.226884 5526 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:25.227365 5526 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:25.228981 5526 catalog_manager.cc:1347] Generated new cluster ID: a3cd3f93cbdf451f95f7aff1d380adcf
I20260808 07:05:25.229034 5526 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:25.265514 5526 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:25.266047 5526 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:25.269774 5526 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf63765f240845d2ade6b6871c73a9d9: Generated new TSK 0
I20260808 07:05:25.269941 5526 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 07:05:25.296828 5551 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 07:05:25.296918 5551 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 07:05:25.297317 5512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:25.278176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44774 (local address 127.29.82.126:41201)
0808 07:05:25.278234 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:25.278236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:25.278338 (+ 102us) server_negotiation.cc:407] Connection header received
0808 07:05:25.278414 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:25.278415 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:25.278427 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:25.278483 (+ 56us) server_negotiation.cc:226] Negotiated authn=JWT
0808 07:05:25.278621 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.279075 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.280138 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.280317 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.280357 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:25.280522 (+ 165us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 07:05:25.297028 (+ 16506us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33667/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 07:05:25.297235 (+ 207us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44774: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33667/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":32}
W20260808 07:05:25.297380 5512 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44774: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33667/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 07:05:25.297380 5550 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:05:25.278111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:41201 (local address 127.0.0.1:44774)
0808 07:05:25.278271 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:25.278282 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:25.278349 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:25.278498 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:25.278499 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:25.278501 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 07:05:25.278564 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:25.278567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.279147 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.279148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:25.280063 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:25.280067 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.280376 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.280377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:25.280436 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:25.280442 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 07:05:25.297172 (+ 16730us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33667/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 07:05:25.297290 (+ 118us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.82.126:41201: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33667/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
I20260808 07:05:25.297865 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 5408
2026-08-08T07:05:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (255 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 07:05:25.347470 30025 mini_oidc.cc:152] Starting JWKS server
I20260808 07:05:25.348146 30025 webserver.cc:460] Webserver started at https://127.0.0.1:36881/ using document root <none> and password file <none>
I20260808 07:05:25.348205 30025 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 07:05:25.348340 30025 webserver.cc:460] Webserver started at http://127.0.0.1:39179/ using document root <none> and password file <none>
2026-08-08T07:05:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:25Z Disabled control of system clock
I20260808 07:05:25.356868 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:46637
--webserver_interface=127.29.82.126
--webserver_port=0
--builtin_ntp_servers=127.29.82.84:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:46637
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36881/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 07:05:25.438153 5560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:25.438364 5560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:25.438383 5560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:25.439482 5560 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:25.439520 5560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:25.439531 5560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:25.439543 5560 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:25.439553 5560 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 07:05:25.439563 5560 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 07:05:25.439572 5560 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36881/jwks.json
I20260808 07:05:25.440878 5560 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:46637
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:46637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36881/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:25.441082 5560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:25.441349 5560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:25.445987 5571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:25.446017 5567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:25.445988 5566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:25.446380 5560 server_base.cc:1034] running on GCE node
I20260808 07:05:25.446631 5560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:25.446911 5560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:25.448052 5560 hybrid_clock.cc:648] HybridClock initialized: now 1786172725448034 us; error 33 us; skew 500 ppm
I20260808 07:05:25.449334 5560 webserver.cc:460] Webserver started at http://127.29.82.126:39845/ using document root <none> and password file <none>
I20260808 07:05:25.449550 5560 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:25.449594 5560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:25.449714 5560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:25.450783 5560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "7f18908cb37f440d89c7ce2b8e1553f4"
format_stamp: "Formatted at 2026-08-08 07:05:25 on dist-test-slave-rmhg"
server_key: "618364eee466e0c72356848caa07bdec"
server_key_iv: "8e7b676558d259d125bf541a1be10cc6"
server_key_version: "encryptionkey@0"
I20260808 07:05:25.451133 5560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "7f18908cb37f440d89c7ce2b8e1553f4"
format_stamp: "Formatted at 2026-08-08 07:05:25 on dist-test-slave-rmhg"
server_key: "618364eee466e0c72356848caa07bdec"
server_key_iv: "8e7b676558d259d125bf541a1be10cc6"
server_key_version: "encryptionkey@0"
I20260808 07:05:25.452407 5560 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:25.453083 5578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:25.453249 5560 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:25.453342 5560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "7f18908cb37f440d89c7ce2b8e1553f4"
format_stamp: "Formatted at 2026-08-08 07:05:25 on dist-test-slave-rmhg"
server_key: "618364eee466e0c72356848caa07bdec"
server_key_iv: "8e7b676558d259d125bf541a1be10cc6"
server_key_version: "encryptionkey@0"
I20260808 07:05:25.453404 5560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:25.464602 5560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:25.464915 5560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:25.465045 5560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:25.468880 5560 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:46637
I20260808 07:05:25.468917 5662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:46637 every 8 connection(s)
I20260808 07:05:25.469336 5560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:25.470106 5663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:25.471171 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 5560
I20260808 07:05:25.471258 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:25.471426 30025 external_mini_cluster.cc:1428] Setting key 4ba94ec4ce4ccaed097caea6802d97c6
I20260808 07:05:25.473425 5663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4: Bootstrap starting.
I20260808 07:05:25.474066 5663 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:25.474376 5663 log.cc:824] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:25.475126 5663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4: No bootstrap required, opened a new log
I20260808 07:05:25.476745 5668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:25.471940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37514 (local address 127.29.82.126:46637)
0808 07:05:25.472120 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:25.472128 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:25.472159 (+ 31us) server_negotiation.cc:407] Connection header received
0808 07:05:25.472573 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:25.472580 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:25.472647 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:25.472759 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:25.472997 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.473932 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.474940 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.475383 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.475472 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:25.476146 (+ 674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:25.476150 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:25.476150 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:25.476306 (+ 156us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:25.476339 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:25.476350 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:25.476398 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:25.476482 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 07:05:25.476546 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":61,"threads_started":1}
I20260808 07:05:25.477277 5663 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f18908cb37f440d89c7ce2b8e1553f4" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46637 } }
I20260808 07:05:25.477452 5663 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:25.477480 5663 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f18908cb37f440d89c7ce2b8e1553f4, State: Initialized, Role: FOLLOWER
I20260808 07:05:25.477579 5663 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f18908cb37f440d89c7ce2b8e1553f4" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46637 } }
I20260808 07:05:25.477661 5663 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:25.477703 5663 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:25.477749 5663 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:25.477849 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:25.478345 5663 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f18908cb37f440d89c7ce2b8e1553f4" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46637 } }
I20260808 07:05:25.478446 5663 leader_election.cc:302] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f18908cb37f440d89c7ce2b8e1553f4; no voters:
I20260808 07:05:25.478622 5663 leader_election.cc:288] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:25.478672 5671 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:25.478828 5671 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [term 1 LEADER]: Becoming Leader. State: Replica: 7f18908cb37f440d89c7ce2b8e1553f4, State: Running, Role: LEADER
I20260808 07:05:25.478904 5663 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:25.478924 5671 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f18908cb37f440d89c7ce2b8e1553f4" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46637 } }
I20260808 07:05:25.479275 5671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f18908cb37f440d89c7ce2b8e1553f4. Latest consensus state: current_term: 1 leader_uuid: "7f18908cb37f440d89c7ce2b8e1553f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f18908cb37f440d89c7ce2b8e1553f4" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46637 } } }
I20260808 07:05:25.479288 5675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f18908cb37f440d89c7ce2b8e1553f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f18908cb37f440d89c7ce2b8e1553f4" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46637 } } }
I20260808 07:05:25.479362 5671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:25.479409 5675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:25.479624 5681 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:25.480314 5681 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:25.481803 5681 catalog_manager.cc:1347] Generated new cluster ID: 01ee0103230d4167af76f3402b042e01
I20260808 07:05:25.481849 5681 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:25.490629 5681 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:25.491222 5681 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:25.493510 5681 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f18908cb37f440d89c7ce2b8e1553f4: Generated new TSK 0
I20260808 07:05:25.493692 5681 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:25.507361 5668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:25.503672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37516 (local address 127.29.82.126:46637)
0808 07:05:25.503733 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:25.503735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:25.503832 (+ 97us) server_negotiation.cc:407] Connection header received
0808 07:05:25.503913 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:25.503914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:25.503927 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:25.503987 (+ 60us) server_negotiation.cc:226] Negotiated authn=JWT
0808 07:05:25.504157 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.504722 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.505881 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.506075 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.506125 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:25.506291 (+ 166us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 07:05:25.507149 (+ 858us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36881/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 07:05:25.507279 (+ 130us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37516: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36881/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 07:05:25.507436 5668 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37516: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36881/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 07:05:25.507789 5710 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:05:25.503602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46637 (local address 127.0.0.1:37516)
0808 07:05:25.503764 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:25.503776 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:25.503844 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:25.503996 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:25.503997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:25.503999 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 07:05:25.504063 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:25.504065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.504798 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.504799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:25.505806 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:25.505809 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.506145 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.506146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:25.506206 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:25.506211 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 07:05:25.507244 (+ 1033us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36881/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 07:05:25.507348 (+ 104us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.82.126:46637: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36881/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":92,"threads_started":1}
I20260808 07:05:25.508013 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 5560
E20260808 07:05:25.523187 5711 webserver.cc:533] Webserver: sslize failed:
E20260808 07:05:25.523275 5711 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T07:05:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (203 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T07:05:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:25Z Disabled control of system clock
I20260808 07:05:25.558982 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:38701
--webserver_interface=127.29.82.126
--webserver_port=0
--builtin_ntp_servers=127.29.82.84:46243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:38701
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/testchainca.cert with env {}
W20260808 07:05:25.641793 5716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:25.642006 5716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:25.642036 5716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:25.643260 5716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:25.643301 5716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:25.643317 5716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:25.643334 5716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:25.643349 5716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 07:05:25.643365 5716 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 07:05:25.643384 5716 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 07:05:25.644953 5716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:38701
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:38701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:25.645241 5716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:25.645449 5716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:25.650187 5723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:25.650247 5725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:25.650226 5716 server_base.cc:1034] running on GCE node
W20260808 07:05:25.650197 5728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:25.650606 5716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:25.650887 5716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:25.652019 5716 hybrid_clock.cc:648] HybridClock initialized: now 1786172725652001 us; error 39 us; skew 500 ppm
I20260808 07:05:25.653329 5716 webserver.cc:460] Webserver started at http://127.29.82.126:33205/ using document root <none> and password file <none>
I20260808 07:05:25.653570 5716 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:25.653636 5716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:25.653769 5716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:25.654819 5716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "f1d6f5b5734743e6a2b4a6db8e8730a1"
format_stamp: "Formatted at 2026-08-08 07:05:25 on dist-test-slave-rmhg"
server_key: "8008e66180c3b0881e433f45efc5332e"
server_key_iv: "da4a6c7849fa63a6e2ecfd59133f9ee0"
server_key_version: "encryptionkey@0"
I20260808 07:05:25.655153 5716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "f1d6f5b5734743e6a2b4a6db8e8730a1"
format_stamp: "Formatted at 2026-08-08 07:05:25 on dist-test-slave-rmhg"
server_key: "8008e66180c3b0881e433f45efc5332e"
server_key_iv: "da4a6c7849fa63a6e2ecfd59133f9ee0"
server_key_version: "encryptionkey@0"
I20260808 07:05:25.656379 5716 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:25.657083 5737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:25.657251 5716 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:25.657339 5716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "f1d6f5b5734743e6a2b4a6db8e8730a1"
format_stamp: "Formatted at 2026-08-08 07:05:25 on dist-test-slave-rmhg"
server_key: "8008e66180c3b0881e433f45efc5332e"
server_key_iv: "da4a6c7849fa63a6e2ecfd59133f9ee0"
server_key_version: "encryptionkey@0"
I20260808 07:05:25.657408 5716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:25.681414 5716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:25.681768 5716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:25.681906 5716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:25.685626 5716 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:38701
I20260808 07:05:25.685658 5820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:38701 every 8 connection(s)
I20260808 07:05:25.685982 5716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:25.686967 5821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:25.689381 5821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1: Bootstrap starting.
I20260808 07:05:25.689956 5821 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:25.690244 5821 log.cc:824] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:25.690907 5821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1: No bootstrap required, opened a new log
I20260808 07:05:25.692487 5821 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1d6f5b5734743e6a2b4a6db8e8730a1" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38701 } }
I20260808 07:05:25.692631 5821 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:25.692665 5821 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1d6f5b5734743e6a2b4a6db8e8730a1, State: Initialized, Role: FOLLOWER
I20260808 07:05:25.692812 5821 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1d6f5b5734743e6a2b4a6db8e8730a1" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38701 } }
I20260808 07:05:25.692893 5821 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:25.692929 5821 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:25.692988 5821 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:25.693604 5821 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1d6f5b5734743e6a2b4a6db8e8730a1" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38701 } }
I20260808 07:05:25.693661 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 5716
I20260808 07:05:25.693701 5821 leader_election.cc:302] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1d6f5b5734743e6a2b4a6db8e8730a1; no voters:
I20260808 07:05:25.693769 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:25.693872 5821 leader_election.cc:288] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:25.693936 30025 external_mini_cluster.cc:1428] Setting key aa22cc4baae99aa23469156fc5ef1904
I20260808 07:05:25.693926 5825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:25.694044 5825 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [term 1 LEADER]: Becoming Leader. State: Replica: f1d6f5b5734743e6a2b4a6db8e8730a1, State: Running, Role: LEADER
I20260808 07:05:25.694172 5821 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:25.694523 5825 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1d6f5b5734743e6a2b4a6db8e8730a1" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38701 } }
I20260808 07:05:25.694901 5828 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1d6f5b5734743e6a2b4a6db8e8730a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1d6f5b5734743e6a2b4a6db8e8730a1" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38701 } } }
I20260808 07:05:25.694998 5828 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:25.695156 5827 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1d6f5b5734743e6a2b4a6db8e8730a1. Latest consensus state: current_term: 1 leader_uuid: "f1d6f5b5734743e6a2b4a6db8e8730a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1d6f5b5734743e6a2b4a6db8e8730a1" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38701 } } }
I20260808 07:05:25.695217 5827 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:25.695497 5844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:25.696014 5844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:25.700078 5830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:25.694440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41532 (local address 127.29.82.126:38701)
0808 07:05:25.694920 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:25.694931 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:25.694962 (+ 31us) server_negotiation.cc:407] Connection header received
0808 07:05:25.695088 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:25.695096 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:25.695168 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:25.695316 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:25.695804 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.696848 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.698020 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.698647 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.698779 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:25.699381 (+ 602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:25.699386 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:25.699386 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:25.699605 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:25.699648 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:25.699663 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:25.699735 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:25.699775 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 07:05:25.699860 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":73,"threads_started":1}
I20260808 07:05:25.701097 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:25.701586 5844 catalog_manager.cc:1347] Generated new cluster ID: 49a4b9af2b8a499c90dde2469f5933ff
I20260808 07:05:25.701639 5844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:25.708614 5844 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:25.709349 5844 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:25.715883 5844 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1d6f5b5734743e6a2b4a6db8e8730a1: Generated new TSK 0
I20260808 07:05:25.716070 5844 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:25.758831 5830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:25.727452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41546 (local address 127.29.82.126:38701)
0808 07:05:25.727509 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:25.727511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:25.727630 (+ 119us) server_negotiation.cc:407] Connection header received
0808 07:05:25.727691 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:25.727692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:25.727705 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:25.727787 (+ 82us) server_negotiation.cc:226] Negotiated authn=JWT
0808 07:05:25.727877 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.728733 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.729523 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.729856 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.729922 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:25.730055 (+ 133us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 07:05:25.758547 (+ 28492us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 07:05:25.758750 (+ 203us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41546: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":32}
W20260808 07:05:25.758915 5830 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41546: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 07:05:25.758919 5865 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:05:25.727394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38701 (local address 127.0.0.1:41546)
0808 07:05:25.727564 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:25.727573 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:25.727630 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:25.727782 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:25.727783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:25.727785 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 07:05:25.727837 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:25.727839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.728802 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.728803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:25.729453 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:25.729456 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:25.729928 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:25.729929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:25.729966 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:25.729970 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 07:05:25.758709 (+ 28739us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 07:05:25.758833 (+ 124us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.82.126:38701: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":85,"threads_started":1}
I20260808 07:05:25.759333 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 5716
2026-08-08T07:05:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (229 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (92 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (91 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:25 dist-test-slave-rmhg krb5kdc[5884](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:25 dist-test-slave-rmhg krb5kdc[5884](info): set up 2 sockets
Aug 08 07:05:25 dist-test-slave-rmhg krb5kdc[5884](info): commencing operation
krb5kdc: starting...
W20260808 07:05:27.058400 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:05:27.178284 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:33461
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:33461
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:27.261472 5906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:27.261708 5906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:27.261741 5906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:27.262928 5906 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:27.262972 5906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:27.262990 5906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:27.263006 5906 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:27.263021 5906 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:27.264559 5906 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:33461
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:33461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:27.264817 5906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:27.265033 5906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:27.269974 5915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:27.270037 5912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:27.270159 5906 server_base.cc:1034] running on GCE node
W20260808 07:05:27.269969 5913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:27.270438 5906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:27.270737 5906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:27.271901 5906 hybrid_clock.cc:648] HybridClock initialized: now 1786172727271885 us; error 30 us; skew 500 ppm
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:27.274458 5906 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:05:27.274900 5906 webserver.cc:460] Webserver started at http://127.29.82.126:39789/ using document root <none> and password file <none>
I20260808 07:05:27.275111 5906 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:27.275156 5906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:27.275282 5906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:27.276356 5906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "d26375b567114262b9434ba303d633dc"
format_stamp: "Formatted at 2026-08-08 07:05:27 on dist-test-slave-rmhg"
server_key: "f4aed2bd8427fc0b37ea28aeccdeaa8e"
server_key_iv: "cf975474643506ad74d269470c96ee5a"
server_key_version: "encryptionkey@0"
I20260808 07:05:27.276700 5906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "d26375b567114262b9434ba303d633dc"
format_stamp: "Formatted at 2026-08-08 07:05:27 on dist-test-slave-rmhg"
server_key: "f4aed2bd8427fc0b37ea28aeccdeaa8e"
server_key_iv: "cf975474643506ad74d269470c96ee5a"
server_key_version: "encryptionkey@0"
I20260808 07:05:27.278136 5906 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:27.278941 5924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:27.279206 5906 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:05:27.279325 5906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "d26375b567114262b9434ba303d633dc"
format_stamp: "Formatted at 2026-08-08 07:05:27 on dist-test-slave-rmhg"
server_key: "f4aed2bd8427fc0b37ea28aeccdeaa8e"
server_key_iv: "cf975474643506ad74d269470c96ee5a"
server_key_version: "encryptionkey@0"
I20260808 07:05:27.279400 5906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:27.306797 5906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:27.309115 5906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:27.309275 5906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:27.313190 5906 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:33461
I20260808 07:05:27.313225 6002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:33461 every 8 connection(s)
I20260808 07:05:27.313603 5906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:27.314337 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 5906
I20260808 07:05:27.314533 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:27.314745 30025 external_mini_cluster.cc:1428] Setting key de84f897ae0dd6211dc00284e6f480a4
I20260808 07:05:27.314754 6003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:27.317727 6003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc: Bootstrap starting.
I20260808 07:05:27.318352 6003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:27.318617 6003 log.cc:824] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:27.319293 6003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc: No bootstrap required, opened a new log
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:27.321321 6003 raft_consensus.cc:348] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d26375b567114262b9434ba303d633dc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 33461 } }
I20260808 07:05:27.321516 6003 raft_consensus.cc:374] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:27.321568 6003 raft_consensus.cc:729] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d26375b567114262b9434ba303d633dc, State: Initialized, Role: FOLLOWER
I20260808 07:05:27.321709 6003 consensus_queue.cc:260] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d26375b567114262b9434ba303d633dc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 33461 } }
I20260808 07:05:27.321797 6003 raft_consensus.cc:388] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:27.321841 6003 raft_consensus.cc:482] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:27.321893 6003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:27.322553 6003 raft_consensus.cc:504] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d26375b567114262b9434ba303d633dc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 33461 } }
I20260808 07:05:27.322670 6003 leader_election.cc:302] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d26375b567114262b9434ba303d633dc; no voters:
I20260808 07:05:27.322862 6003 leader_election.cc:288] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:27.322925 6009 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:27.323091 6009 raft_consensus.cc:686] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [term 1 LEADER]: Becoming Leader. State: Replica: d26375b567114262b9434ba303d633dc, State: Running, Role: LEADER
I20260808 07:05:27.323158 6003 sys_catalog.cc:564] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:27.323191 6009 consensus_queue.cc:237] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d26375b567114262b9434ba303d633dc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 33461 } }
I20260808 07:05:27.324505 6010 sys_catalog.cc:455] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d26375b567114262b9434ba303d633dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d26375b567114262b9434ba303d633dc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 33461 } } }
I20260808 07:05:27.324596 6010 sys_catalog.cc:458] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:27.325110 6011 sys_catalog.cc:455] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader d26375b567114262b9434ba303d633dc. Latest consensus state: current_term: 1 leader_uuid: "d26375b567114262b9434ba303d633dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d26375b567114262b9434ba303d633dc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 33461 } } }
W20260808 07:05:27.325194 6031 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 07:05:27.325268 6011 sys_catalog.cc:458] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc [sys.catalog]: This master's current role is: LEADER
W20260808 07:05:27.325336 6031 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:05:27.325506 6034 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:27.325680 6034 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:27.326124 6006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:27.315346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32980 (local address 127.29.82.126:33461)
0808 07:05:27.315556 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:27.315565 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:27.315592 (+ 27us) server_negotiation.cc:407] Connection header received
0808 07:05:27.316157 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:27.316165 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:27.316218 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:27.316357 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:27.317040 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.318088 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.318871 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.319311 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.319412 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:27.322021 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:27.322026 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:27.322027 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:27.322039 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:27.324099 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:27.324575 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:27.324579 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:27.324579 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:27.324697 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:27.324932 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:27.324933 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:27.324933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:27.325322 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:27.325500 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:27.325772 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 07:05:27.325918 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":90,"threads_started":1}
I20260808 07:05:27.327466 6034 catalog_manager.cc:1347] Generated new cluster ID: 2e8609a897e24d3cb875b3bacf4170d7
I20260808 07:05:27.327510 6034 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:27.353075 6034 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:27.353677 6034 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:27.360381 6034 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d26375b567114262b9434ba303d633dc: Generated new TSK 0
I20260808 07:05:27.360589 6034 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:05:27.396418 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:33461
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:27.481385 6043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:27.481602 6043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:27.481626 6043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:27.482824 6043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:27.482867 6043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:27.482892 6043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:05:27.484375 6043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:33461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:27.484587 6043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:27.484773 6043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:27.489753 6053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:27.489776 6054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:27.489705 6056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:27.490015 6043 server_base.cc:1034] running on GCE node
I20260808 07:05:27.490218 6043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:27.490456 6043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:27.491601 6043 hybrid_clock.cc:648] HybridClock initialized: now 1786172727491580 us; error 34 us; skew 500 ppm
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:27.494241 6043 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:05:27.494724 6043 webserver.cc:460] Webserver started at http://127.29.82.65:39017/ using document root <none> and password file <none>
I20260808 07:05:27.494961 6043 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:27.495010 6043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:27.495146 6043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:27.496215 6043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "fdd6b218d8ef4e01931ffc4ed5af26f9"
format_stamp: "Formatted at 2026-08-08 07:05:27 on dist-test-slave-rmhg"
server_key: "f0c76fca367176ac868fcce5ced161c3"
server_key_iv: "3641f2c3bb5575ae83983a1c5341ab5c"
server_key_version: "encryptionkey@0"
I20260808 07:05:27.496555 6043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "fdd6b218d8ef4e01931ffc4ed5af26f9"
format_stamp: "Formatted at 2026-08-08 07:05:27 on dist-test-slave-rmhg"
server_key: "f0c76fca367176ac868fcce5ced161c3"
server_key_iv: "3641f2c3bb5575ae83983a1c5341ab5c"
server_key_version: "encryptionkey@0"
I20260808 07:05:27.498109 6043 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:27.498895 6066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:27.499053 6043 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:27.499133 6043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "fdd6b218d8ef4e01931ffc4ed5af26f9"
format_stamp: "Formatted at 2026-08-08 07:05:27 on dist-test-slave-rmhg"
server_key: "f0c76fca367176ac868fcce5ced161c3"
server_key_iv: "3641f2c3bb5575ae83983a1c5341ab5c"
server_key_version: "encryptionkey@0"
I20260808 07:05:27.499197 6043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:27.517695 6043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:27.519696 6043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:27.519850 6043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:27.520099 6043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:27.520406 6043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:27.520439 6043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:27.520469 6043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:27.520498 6043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:27.526345 6043 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:45643
I20260808 07:05:27.526398 6225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:45643 every 8 connection(s)
I20260808 07:05:27.526728 6043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:05:27.532753 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 6043
I20260808 07:05:27.532866 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:27.533077 30025 external_mini_cluster.cc:1428] Setting key daed45e01c5b5c86aca5e6cfe4fb4be9
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:27.536755 6006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:27.527589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:49477 (local address 127.29.82.126:33461)
0808 07:05:27.527667 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:27.527670 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:27.527822 (+ 152us) server_negotiation.cc:407] Connection header received
0808 07:05:27.528793 (+ 971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:27.528796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:27.528809 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:27.528863 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:27.529576 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.530348 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.531377 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.531669 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.531734 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:27.534180 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:27.534182 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:27.534183 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:27.534191 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:27.535453 (+ 1262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:27.535844 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:27.535845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:27.535845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:27.535900 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:27.536125 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:27.536125 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:27.536126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:27.536239 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:27.536295 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:27.536568 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 07:05:27.536661 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 07:05:27.536940 6234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:27.527503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:33461 (local address 127.29.82.65:49477)
0808 07:05:27.527699 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:27.527739 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:27.528675 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:27.528937 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:27.528941 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:27.529231 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:27.529454 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:27.529461 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.530455 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.530456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:27.531301 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:27.531304 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.531765 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.531766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:27.531883 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:27.532361 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:27.532371 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:27.534080 (+ 1709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:27.535538 (+ 1458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:27.535545 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:27.535548 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:27.535775 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:27.535955 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:27.535956 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:27.535956 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:27.536067 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:27.536295 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:27.536302 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:27.536446 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 07:05:27.536547 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 07:05:27.536714 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":99,"threads_started":1}
I20260808 07:05:27.537514 6227 heartbeater.cc:347] Connected to a master server at 127.29.82.126:33461
I20260808 07:05:27.537629 6227 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:27.537853 6227 heartbeater.cc:511] Master 127.29.82.126:33461 requested a full tablet report, sending...
I20260808 07:05:27.538498 5955 ts_manager.cc:194] Registered new tserver with Master: fdd6b218d8ef4e01931ffc4ed5af26f9 (127.29.82.65:45643)
I20260808 07:05:27.539409 5955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:49477
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:05:27.560227 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:33461
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:27.643409 6237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:27.643642 6237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:27.643666 6237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:27.644850 6237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:27.644893 6237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:27.644918 6237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:05:27.646467 6237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:33461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:27.646713 6237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:27.646935 6237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:27.651971 6246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:27.652014 6237 server_base.cc:1034] running on GCE node
W20260808 07:05:27.651980 6248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:27.651990 6245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:27.652354 6237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:27.652575 6237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:27.653728 6237 hybrid_clock.cc:648] HybridClock initialized: now 1786172727653716 us; error 31 us; skew 500 ppm
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:27.656176 6237 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:05:27.656591 6237 webserver.cc:460] Webserver started at http://127.29.82.66:35417/ using document root <none> and password file <none>
I20260808 07:05:27.656790 6237 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:27.656829 6237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:27.656921 6237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:27.657968 6237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "6659aafd6f3644dfacd72ca51b757cd2"
format_stamp: "Formatted at 2026-08-08 07:05:27 on dist-test-slave-rmhg"
server_key: "7a68050c38e4b793a9a2b1e0aae85772"
server_key_iv: "691c630bf6447376a1050d7927fb1402"
server_key_version: "encryptionkey@0"
I20260808 07:05:27.658270 6237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "6659aafd6f3644dfacd72ca51b757cd2"
format_stamp: "Formatted at 2026-08-08 07:05:27 on dist-test-slave-rmhg"
server_key: "7a68050c38e4b793a9a2b1e0aae85772"
server_key_iv: "691c630bf6447376a1050d7927fb1402"
server_key_version: "encryptionkey@0"
I20260808 07:05:27.659500 6237 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:05:27.660260 6262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:27.660456 6237 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:05:27.660552 6237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "6659aafd6f3644dfacd72ca51b757cd2"
format_stamp: "Formatted at 2026-08-08 07:05:27 on dist-test-slave-rmhg"
server_key: "7a68050c38e4b793a9a2b1e0aae85772"
server_key_iv: "691c630bf6447376a1050d7927fb1402"
server_key_version: "encryptionkey@0"
I20260808 07:05:27.660609 6237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:27.680289 6237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:27.682629 6237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:27.682780 6237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:27.683005 6237 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:27.683341 6237 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:27.683383 6237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:27.683405 6237 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:27.683440 6237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:27.688958 6237 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:42379
I20260808 07:05:27.689033 6434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:42379 every 8 connection(s)
I20260808 07:05:27.689339 6237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:27.696182 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 6237
I20260808 07:05:27.696290 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:27.696472 30025 external_mini_cluster.cc:1428] Setting key 50422f2612ce9db983889bca80c27d58
I20260808 07:05:27.699213 6006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:27.690126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:40285 (local address 127.29.82.126:33461)
0808 07:05:27.690192 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:27.690195 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:27.690391 (+ 196us) server_negotiation.cc:407] Connection header received
0808 07:05:27.691382 (+ 991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:27.691384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:27.691396 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:27.691449 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:27.692138 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.692658 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.693714 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.693921 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.693988 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:27.696307 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:27.696309 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:27.696309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:27.696319 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:27.697761 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:27.698217 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:27.698218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:27.698219 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:27.698274 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:27.698527 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:27.698528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:27.698528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:27.698635 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:27.698681 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:27.699018 (+ 337us) server_negotiation.cc:299] Negotiation successful
0808 07:05:27.699119 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:05:27.699385 6439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:27.690083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:33461 (local address 127.29.82.66:40285)
0808 07:05:27.690268 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:27.690305 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:27.691255 (+ 950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:27.691537 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:27.691543 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:27.691822 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:27.692039 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:27.692044 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.692747 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.692748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:27.693631 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:27.693634 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.693991 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.693992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:27.694123 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:27.694666 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:27.694675 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:27.696188 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:27.697840 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:27.697848 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:27.697850 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:27.698146 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:27.698329 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:27.698330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:27.698330 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:27.698470 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:27.698685 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:27.698690 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:27.698861 (+ 171us) client_negotiation.cc:769] Sending connection context
0808 07:05:27.698987 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 07:05:27.699170 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":97,"threads_started":1}
I20260808 07:05:27.699846 6436 heartbeater.cc:347] Connected to a master server at 127.29.82.126:33461
I20260808 07:05:27.699949 6436 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:27.700129 6436 heartbeater.cc:511] Master 127.29.82.126:33461 requested a full tablet report, sending...
I20260808 07:05:27.700516 5955 ts_manager.cc:194] Registered new tserver with Master: 6659aafd6f3644dfacd72ca51b757cd2 (127.29.82.66:42379)
I20260808 07:05:27.700899 5955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:40285
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:05:27.724068 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:33461
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:27.808337 6442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:27.808563 6442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:27.808596 6442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:27.809825 6442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:27.809868 6442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:27.809903 6442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:05:27.811414 6442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:33461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:27.811666 6442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:27.811885 6442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:27.816766 6449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:27.816774 6448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:27.816774 6453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:27.817004 6442 server_base.cc:1034] running on GCE node
I20260808 07:05:27.817268 6442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:27.817512 6442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:27.818678 6442 hybrid_clock.cc:648] HybridClock initialized: now 1786172727818665 us; error 30 us; skew 500 ppm
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:27.821094 6442 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:05:27.821609 6442 webserver.cc:460] Webserver started at http://127.29.82.67:40321/ using document root <none> and password file <none>
I20260808 07:05:27.821834 6442 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:27.821885 6442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:27.822011 6442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:27.823076 6442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "aba408a45fbd4b6495f74348f9ab3905"
format_stamp: "Formatted at 2026-08-08 07:05:27 on dist-test-slave-rmhg"
server_key: "4023e58fbdf108fe0a8236ae8b41e9a2"
server_key_iv: "f29c2f80d09cac59ac74a3bbf922f8ca"
server_key_version: "encryptionkey@0"
I20260808 07:05:27.823400 6442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "aba408a45fbd4b6495f74348f9ab3905"
format_stamp: "Formatted at 2026-08-08 07:05:27 on dist-test-slave-rmhg"
server_key: "4023e58fbdf108fe0a8236ae8b41e9a2"
server_key_iv: "f29c2f80d09cac59ac74a3bbf922f8ca"
server_key_version: "encryptionkey@0"
I20260808 07:05:27.824831 6442 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:05:27.825554 6466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:27.825731 6442 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:27.825819 6442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "aba408a45fbd4b6495f74348f9ab3905"
format_stamp: "Formatted at 2026-08-08 07:05:27 on dist-test-slave-rmhg"
server_key: "4023e58fbdf108fe0a8236ae8b41e9a2"
server_key_iv: "f29c2f80d09cac59ac74a3bbf922f8ca"
server_key_version: "encryptionkey@0"
I20260808 07:05:27.825870 6442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:27.842586 6442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:27.844786 6442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:27.844931 6442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:27.845208 6442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:27.845513 6442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:27.845547 6442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:27.845577 6442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:27.845592 6442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:27.851075 6442 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:33111
I20260808 07:05:27.851145 6652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:33111 every 8 connection(s)
I20260808 07:05:27.851442 6442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:05:27.860733 6006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:27.852158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:41677 (local address 127.29.82.126:33461)
0808 07:05:27.852206 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:27.852208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:27.852410 (+ 202us) server_negotiation.cc:407] Connection header received
0808 07:05:27.853437 (+ 1027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:27.853439 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:27.853453 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:27.853504 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:27.854157 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.854666 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.855677 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.855868 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.855926 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:27.858073 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:27.858075 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:27.858076 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:27.858083 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:27.859355 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:27.859756 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:27.859757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:27.859758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:27.859816 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:27.860049 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:27.860050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:27.860050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:27.860192 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:27.860256 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:27.860577 (+ 321us) server_negotiation.cc:299] Negotiation successful
0808 07:05:27.860661 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:05:27.860724 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 6442
I20260808 07:05:27.860803 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:27.860955 30025 external_mini_cluster.cc:1428] Setting key 6a09cfa597db22d420a81c84a16bc388
I20260808 07:05:27.861073 6656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:27.852121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:33461 (local address 127.29.82.67:41677)
0808 07:05:27.852287 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:27.852326 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:27.853329 (+ 1003us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:27.853589 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:27.853593 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:27.853858 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:27.854063 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:27.854067 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.854754 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.854755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:27.855591 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:27.855593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.855938 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.855939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:27.856087 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:27.856593 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:27.856602 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:27.857974 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:27.859434 (+ 1460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:27.859442 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:27.859444 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:27.859684 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:27.859872 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:27.859873 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:27.859873 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:27.859985 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:27.860252 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:27.860259 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:27.860420 (+ 161us) client_negotiation.cc:769] Sending connection context
0808 07:05:27.860566 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 07:05:27.860757 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
I20260808 07:05:27.861631 6653 heartbeater.cc:347] Connected to a master server at 127.29.82.126:33461
I20260808 07:05:27.861748 6653 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:27.861940 6653 heartbeater.cc:511] Master 127.29.82.126:33461 requested a full tablet report, sending...
I20260808 07:05:27.862308 5955 ts_manager.cc:194] Registered new tserver with Master: aba408a45fbd4b6495f74348f9ab3905 (127.29.82.67:33111)
I20260808 07:05:27.862685 5955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:41677
I20260808 07:05:27.873090 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/test-admin.keytab.
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:27.889982 30025 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 07:05:27.891729 6661 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:05:27.890882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48176 (local address 127.29.82.65:45643)
0808 07:05:27.891093 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:27.891098 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:27.891109 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:05:27.891135 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:27.891136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:27.891150 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:27.891220 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:27.891647 (+ 427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48176: BlockingRecv error: recv got EOF from 127.0.0.1:48176 (error 108)
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":95,"threads_started":1}
W20260808 07:05:27.891835 30025 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/krb5cc' of type FILE
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:27.892791 30025 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:27.893620 30025 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.65@KRBTEST.COM
I20260808 07:05:27.900941 6661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:27.894128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48186 (local address 127.29.82.65:45643)
0808 07:05:27.894179 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:27.894181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:27.894189 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:27.894234 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:27.894235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:27.894244 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:27.894287 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:27.894641 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.895402 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.896128 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.896500 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.896565 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:27.898472 (+ 1907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:27.898481 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:27.898482 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:27.898489 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:27.899954 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:27.900289 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:27.900292 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:27.900292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:27.900353 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:27.900518 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:27.900519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:27.900519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:27.900659 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:27.900767 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:27.900803 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 07:05:27.900864 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260808 07:05:27.902649 6661 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:05:27.902172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48200 (local address 127.29.82.65:45643)
0808 07:05:27.902228 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:27.902230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:27.902255 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:05:27.902303 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:27.902303 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:27.902312 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:27.902355 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:27.902601 (+ 246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48200: BlockingRecv error: recv got EOF from 127.0.0.1:48200 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 07:05:27.902740 30025 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/krb5cc' of type FILE
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:27.903661 30025 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:27.904454 30025 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.65@KRBTEST.COM
I20260808 07:05:27.910796 6661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:27.904913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48202 (local address 127.29.82.65:45643)
0808 07:05:27.904953 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:27.904955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:27.904984 (+ 29us) server_negotiation.cc:407] Connection header received
0808 07:05:27.905047 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:27.905048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:27.905057 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:27.905101 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:27.905474 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.905957 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.906617 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.906811 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.906866 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:27.908733 (+ 1867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:27.908735 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:27.908735 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:27.908742 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:27.909865 (+ 1123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:27.910183 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:27.910184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:27.910185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:27.910245 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:27.910387 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:27.910387 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:27.910388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:27.910516 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:27.910595 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:27.910670 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 07:05:27.910736 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 07:05:27.912194 6661 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:05:27.911730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48214 (local address 127.29.82.65:45643)
0808 07:05:27.911779 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:27.911781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:27.911788 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:05:27.911840 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:27.911841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:27.911848 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:27.911888 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:27.912148 (+ 260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48214: BlockingRecv error: recv got EOF from 127.0.0.1:48214 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260808 07:05:27.912297 30025 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172701750152-30025-0/krb5kdc/krb5cc' of type FILE
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:27.913241 30025 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:27.914007 30025 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 07:05:27 dist-test-slave-rmhg krb5kdc[5884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.65@KRBTEST.COM
I20260808 07:05:27.920358 6661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:27.914516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48228 (local address 127.29.82.65:45643)
0808 07:05:27.914560 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:27.914562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:27.914590 (+ 28us) server_negotiation.cc:407] Connection header received
0808 07:05:27.914647 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:27.914648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:27.914655 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:27.914694 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:27.915002 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.915459 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.916127 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:27.916297 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:27.916338 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:27.918223 (+ 1885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:27.918224 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:27.918225 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:27.918231 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:27.919443 (+ 1212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:27.919737 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:27.919738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:27.919738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:27.919783 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:27.919991 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:27.919992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:27.919992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:27.920090 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:27.920169 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:27.920234 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 07:05:27.920292 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 07:05:27.921003 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 6043
I20260808 07:05:27.933355 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 6237
I20260808 07:05:27.943270 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 6442
I20260808 07:05:27.955717 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 5906
2026-08-08T07:05:27Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2019 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:28 dist-test-slave-rmhg krb5kdc[6683](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:28 dist-test-slave-rmhg krb5kdc[6683](info): set up 2 sockets
Aug 08 07:05:28 dist-test-slave-rmhg krb5kdc[6683](info): commencing operation
krb5kdc: starting...
W20260808 07:05:29.084254 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:05:29 dist-test-slave-rmhg krb5kdc[6683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:29Z Disabled control of system clock
WARNING: no policy specified for oryx/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.126.keytab.
Entry for principal oryx/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.126.keytab.
I20260808 07:05:29.203845 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:43645
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.126.keytab
--principal=oryx/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:45293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:43645
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:29.285622 6700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:29.285831 6700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:29.285861 6700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:29.286986 6700 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:29.287026 6700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:29.287045 6700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:29.287060 6700 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:29.287075 6700 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:29.288538 6700 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:45293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:43645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.126.keytab
--principal=oryx/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:43645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:29.288781 6700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:29.288995 6700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:29.293757 6709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:29.293763 6711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:29.293792 6700 server_base.cc:1034] running on GCE node
W20260808 07:05:29.293901 6714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:29.294157 6700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:29.294411 6700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:29.295542 6700 hybrid_clock.cc:648] HybridClock initialized: now 1786172729295525 us; error 31 us; skew 500 ppm
Aug 08 07:05:29 dist-test-slave-rmhg krb5kdc[6683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:29.298137 6700 init.cc:377] Logged in from keytab as oryx/127.29.82.126@KRBTEST.COM (short username oryx)
I20260808 07:05:29.298629 6700 webserver.cc:460] Webserver started at http://127.29.82.126:35753/ using document root <none> and password file <none>
I20260808 07:05:29.298856 6700 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:29.298906 6700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:29.299045 6700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:29.300102 6700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "8caf019b6be6444081601acfda7fb6fc"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "0e9628864704d80ad6ba2ba56ee72d53"
server_key_iv: "25783cfc9583630a818eaac0263d37f9"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.300442 6700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "8caf019b6be6444081601acfda7fb6fc"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "0e9628864704d80ad6ba2ba56ee72d53"
server_key_iv: "25783cfc9583630a818eaac0263d37f9"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.301771 6700 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:29.302488 6721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:29.302657 6700 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:29.302757 6700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "8caf019b6be6444081601acfda7fb6fc"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "0e9628864704d80ad6ba2ba56ee72d53"
server_key_iv: "25783cfc9583630a818eaac0263d37f9"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.302815 6700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:29.317641 6700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:29.319859 6700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:29.320010 6700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:29.324188 6700 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:43645
I20260808 07:05:29.324225 6809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:43645 every 8 connection(s)
I20260808 07:05:29.324637 6700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:29.325721 6810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:29.328114 6810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc: Bootstrap starting.
I20260808 07:05:29.328706 6810 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:29.329008 6810 log.cc:824] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:29.329139 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 6700
I20260808 07:05:29.329282 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:05:29.329481 30025 external_mini_cluster.cc:1428] Setting key 24bc02ac6d2ef220fc90018f44cd0779
I20260808 07:05:29.329864 6810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc: No bootstrap required, opened a new log
I20260808 07:05:29.331702 6810 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } }
I20260808 07:05:29.331845 6810 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:29.331878 6810 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8caf019b6be6444081601acfda7fb6fc, State: Initialized, Role: FOLLOWER
I20260808 07:05:29.332010 6810 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } }
I20260808 07:05:29.332093 6810 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:29.332126 6810 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:29.332176 6810 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:29.332720 6810 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } }
I20260808 07:05:29.332818 6810 leader_election.cc:302] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8caf019b6be6444081601acfda7fb6fc; no voters:
I20260808 07:05:29.332975 6810 leader_election.cc:288] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:29.333006 6818 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:29.333127 6818 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [term 1 LEADER]: Becoming Leader. State: Replica: 8caf019b6be6444081601acfda7fb6fc, State: Running, Role: LEADER
I20260808 07:05:29.333310 6810 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:29.333304 6818 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } }
I20260808 07:05:29.333770 6823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8caf019b6be6444081601acfda7fb6fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } }
I20260808 07:05:29.333865 6823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:29.334024 6821 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8caf019b6be6444081601acfda7fb6fc. Latest consensus state: current_term: 1 leader_uuid: "8caf019b6be6444081601acfda7fb6fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } }
I20260808 07:05:29.334087 6821 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:29.334775 6828 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:29.335289 6828 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 07:05:29 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
I20260808 07:05:29.337383 6828 catalog_manager.cc:1347] Generated new cluster ID: 438266a4eca24c028c06bbd2d25dce84
I20260808 07:05:29.337435 6828 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:29.341262 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:29.329997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47306 (local address 127.29.82.126:43645)
0808 07:05:29.330190 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:29.330200 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:29.330228 (+ 28us) server_negotiation.cc:407] Connection header received
0808 07:05:29.331070 (+ 842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:29.331078 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:29.331131 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:29.331263 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:29.331885 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:29.333285 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:29.334339 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:29.335108 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:29.335211 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:29.337653 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:29.337656 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:29.337657 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:29.337667 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:29.339481 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:29.339835 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:29.339838 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:29.339838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:29.339929 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:29.340086 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:29.340086 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:29.340087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:29.340356 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:29.340490 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:29.340903 (+ 413us) server_negotiation.cc:299] Negotiation successful
0808 07:05:29.341035 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":86,"threads_started":1}
I20260808 07:05:29.351142 6828 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:29.351722 6828 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:29.355757 6828 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc: Generated new TSK 0
I20260808 07:05:29.355923 6828 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.65.keytab.
Entry for principal oryx/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.65.keytab.
I20260808 07:05:29.388000 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:43645
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.65.keytab
--principal=oryx/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:45293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:29.471606 6847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:29.471836 6847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:29.471866 6847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:29.473024 6847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:29.473065 6847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:29.473101 6847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:05:29.474597 6847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:45293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.65.keytab
--principal=oryx/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:43645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:29.474852 6847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:29.475071 6847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:29.480275 6855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:29.480456 6857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:29.480477 6847 server_base.cc:1034] running on GCE node
W20260808 07:05:29.480307 6854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:29.480727 6847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:29.480943 6847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:29.482084 6847 hybrid_clock.cc:648] HybridClock initialized: now 1786172729482060 us; error 42 us; skew 500 ppm
Aug 08 07:05:29 dist-test-slave-rmhg krb5kdc[6683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:29.484587 6847 init.cc:377] Logged in from keytab as oryx/127.29.82.65@KRBTEST.COM (short username oryx)
I20260808 07:05:29.485036 6847 webserver.cc:460] Webserver started at http://127.29.82.65:38609/ using document root <none> and password file <none>
I20260808 07:05:29.485284 6847 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:29.485347 6847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:29.485461 6847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:29.486478 6847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "d19002f56a194dc7b126516d01a01cce"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "148e692b390daf266afb130e9f05c441"
server_key_iv: "56a99de5cbe644157b39697a83155462"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.486785 6847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "d19002f56a194dc7b126516d01a01cce"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "148e692b390daf266afb130e9f05c441"
server_key_iv: "56a99de5cbe644157b39697a83155462"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.488018 6847 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:29.488766 6868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:29.488929 6847 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:29.489018 6847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "d19002f56a194dc7b126516d01a01cce"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "148e692b390daf266afb130e9f05c441"
server_key_iv: "56a99de5cbe644157b39697a83155462"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.489080 6847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:29.499711 6847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:29.501947 6847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:29.502086 6847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:29.502313 6847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:29.502641 6847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:29.502677 6847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:29.502707 6847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:29.502725 6847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:29.508647 6847 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:39795
I20260808 07:05:29.508688 7041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:39795 every 8 connection(s)
I20260808 07:05:29.509033 6847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:05:29.514065 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 6847
I20260808 07:05:29.514185 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:29.514385 30025 external_mini_cluster.cc:1428] Setting key 3ea443011327850c40d13924b52fee6b
Aug 08 07:05:29 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
I20260808 07:05:29.518865 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:29.509803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:42891 (local address 127.29.82.126:43645)
0808 07:05:29.509872 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:29.509874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:29.510060 (+ 186us) server_negotiation.cc:407] Connection header received
0808 07:05:29.510533 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:29.510534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:29.510546 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:29.510608 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:29.511588 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:29.512133 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:29.513178 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:29.513428 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:29.513492 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:29.515919 (+ 2427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:29.515921 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:29.515922 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:29.515930 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:29.517380 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:29.517830 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:29.517832 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:29.517832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:29.517911 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:29.518188 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:29.518189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:29.518189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:29.518324 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:29.518389 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:29.518683 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 07:05:29.518774 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 07:05:29.518966 7046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:29.509755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:42891)
0808 07:05:29.509919 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:29.509964 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:29.510443 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:29.510674 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:29.510677 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:29.511249 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:29.511447 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:29.511452 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:29.512201 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:29.512202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:29.513057 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:29.513060 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:29.513527 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:29.513528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:29.513650 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:29.514244 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:29.514255 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:29.515827 (+ 1572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:29.517511 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:29.517518 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:29.517520 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:29.517761 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:29.517996 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:29.517997 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:29.517998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:29.518121 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:29.518386 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:29.518391 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:29.518552 (+ 161us) client_negotiation.cc:769] Sending connection context
0808 07:05:29.518646 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 07:05:29.518780 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260808 07:05:29.519517 7043 heartbeater.cc:347] Connected to a master server at 127.29.82.126:43645
I20260808 07:05:29.519618 7043 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:29.519802 7043 heartbeater.cc:511] Master 127.29.82.126:43645 requested a full tablet report, sending...
I20260808 07:05:29.520411 6751 ts_manager.cc:194] Registered new tserver with Master: d19002f56a194dc7b126516d01a01cce (127.29.82.65:39795)
I20260808 07:05:29.521368 6751 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:42891
WARNING: no policy specified for oryx/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.66.keytab.
Entry for principal oryx/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.66.keytab.
I20260808 07:05:29.539947 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:43645
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.66.keytab
--principal=oryx/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:45293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:29.623966 7049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:29.624221 7049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:29.624264 7049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:29.625660 7049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:29.625710 7049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:29.625748 7049 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:05:29.627308 7049 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:45293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.66.keytab
--principal=oryx/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:43645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:29.627573 7049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:29.627820 7049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:29.632864 7062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:29.632983 7049 server_base.cc:1034] running on GCE node
W20260808 07:05:29.632928 7058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:29.632896 7059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:29.633316 7049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:29.633590 7049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:29.634732 7049 hybrid_clock.cc:648] HybridClock initialized: now 1786172729634710 us; error 36 us; skew 500 ppm
Aug 08 07:05:29 dist-test-slave-rmhg krb5kdc[6683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:29.637261 7049 init.cc:377] Logged in from keytab as oryx/127.29.82.66@KRBTEST.COM (short username oryx)
I20260808 07:05:29.637688 7049 webserver.cc:460] Webserver started at http://127.29.82.66:36435/ using document root <none> and password file <none>
I20260808 07:05:29.637892 7049 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:29.637936 7049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:29.638085 7049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:29.639169 7049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "b8d771caf9ba4a568daa78ffd425fd8e"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "95c26a4251e3dcbc095263aa217a4a84"
server_key_iv: "8eb1c181d2547e954656ba5c8484cb86"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.639506 7049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "b8d771caf9ba4a568daa78ffd425fd8e"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "95c26a4251e3dcbc095263aa217a4a84"
server_key_iv: "8eb1c181d2547e954656ba5c8484cb86"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.640799 7049 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:05:29.641615 7070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:29.641793 7049 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:05:29.641885 7049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "b8d771caf9ba4a568daa78ffd425fd8e"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "95c26a4251e3dcbc095263aa217a4a84"
server_key_iv: "8eb1c181d2547e954656ba5c8484cb86"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.641952 7049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:29.654661 7049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:29.656631 7049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:29.656761 7049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:29.656999 7049 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:29.657383 7049 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:29.657419 7049 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:29.657449 7049 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:29.657466 7049 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:29.663129 7049 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:43875
I20260808 07:05:29.663196 7241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:43875 every 8 connection(s)
I20260808 07:05:29.663486 7049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:05:29.665714 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 7049
I20260808 07:05:29.665820 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:29.666033 30025 external_mini_cluster.cc:1428] Setting key bfe840687bc9f696237849800b5060ae
Aug 08 07:05:29 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
I20260808 07:05:29.673379 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:29.664204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:49473 (local address 127.29.82.126:43645)
0808 07:05:29.664278 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:29.664280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:29.664539 (+ 259us) server_negotiation.cc:407] Connection header received
0808 07:05:29.665032 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:29.665034 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:29.665045 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:29.665112 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:29.666394 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:29.666989 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:29.668353 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:29.668584 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:29.668660 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:29.670802 (+ 2142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:29.670804 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:29.670804 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:29.670812 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:29.672077 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:29.672451 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:29.672452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:29.672453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:29.672504 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:29.672731 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:29.672732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:29.672733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:29.672846 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:29.672902 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:29.673204 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 07:05:29.673285 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 07:05:29.673609 7245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:29.664178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:49473)
0808 07:05:29.664362 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:29.664408 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:29.664924 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:29.665203 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:29.665206 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:29.666011 (+ 805us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:29.666302 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:29.666309 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:29.667083 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:29.667084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:29.668252 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:29.668255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:29.668674 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:29.668675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:29.668788 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:29.669337 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:29.669347 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:29.670712 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:29.672152 (+ 1440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:29.672160 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:29.672163 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:29.672383 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:29.672567 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:29.672568 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:29.672568 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:29.672675 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:29.672902 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:29.672908 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:29.673052 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 07:05:29.673143 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 07:05:29.673331 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":92,"threads_started":1}
I20260808 07:05:29.674068 7243 heartbeater.cc:347] Connected to a master server at 127.29.82.126:43645
I20260808 07:05:29.674165 7243 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:29.674343 7243 heartbeater.cc:511] Master 127.29.82.126:43645 requested a full tablet report, sending...
I20260808 07:05:29.674734 6751 ts_manager.cc:194] Registered new tserver with Master: b8d771caf9ba4a568daa78ffd425fd8e (127.29.82.66:43875)
WARNING: no policy specified for oryx/127.29.82.67@KRBTEST.COM; defaulting to no policy
I20260808 07:05:29.675256 6751 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:49473
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.67.keytab.
Entry for principal oryx/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.67.keytab.
I20260808 07:05:29.694051 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:43645
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.67.keytab
--principal=oryx/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:45293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:29.779691 7249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:29.779882 7249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:29.779903 7249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:29.780982 7249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:29.781018 7249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:29.781042 7249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:05:29.782467 7249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:45293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.67.keytab
--principal=oryx/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:43645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:29.782657 7249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:29.782851 7249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:29.788228 7261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:29.788220 7259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:29.788220 7258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:29.788600 7249 server_base.cc:1034] running on GCE node
I20260808 07:05:29.788787 7249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:29.788993 7249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:29.790124 7249 hybrid_clock.cc:648] HybridClock initialized: now 1786172729790113 us; error 29 us; skew 500 ppm
Aug 08 07:05:29 dist-test-slave-rmhg krb5kdc[6683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:29.795372 7249 init.cc:377] Logged in from keytab as oryx/127.29.82.67@KRBTEST.COM (short username oryx)
I20260808 07:05:29.795877 7249 webserver.cc:460] Webserver started at http://127.29.82.67:35151/ using document root <none> and password file <none>
I20260808 07:05:29.796116 7249 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:29.796162 7249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:29.796294 7249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:29.797410 7249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "e6cdcf6d8bd24de4aad96397913d3f6b"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "314ceb82c56f2e44a351dc39c56f3d0a"
server_key_iv: "c8fa414843dbde1456c0560ca2ce71af"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.797745 7249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "e6cdcf6d8bd24de4aad96397913d3f6b"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "314ceb82c56f2e44a351dc39c56f3d0a"
server_key_iv: "c8fa414843dbde1456c0560ca2ce71af"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.799003 7249 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:29.799707 7272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:29.799857 7249 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:29.799942 7249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "e6cdcf6d8bd24de4aad96397913d3f6b"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "314ceb82c56f2e44a351dc39c56f3d0a"
server_key_iv: "c8fa414843dbde1456c0560ca2ce71af"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.800009 7249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:29.821229 7249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:29.823524 7249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:29.823658 7249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:29.823913 7249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:29.824231 7249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:29.824265 7249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:29.824287 7249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:29.824309 7249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:29.829912 7249 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:39831
I20260808 07:05:29.829972 7445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:39831 every 8 connection(s)
I20260808 07:05:29.830304 7249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:05:29 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
I20260808 07:05:29.839749 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:29.831049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:39585 (local address 127.29.82.126:43645)
0808 07:05:29.831117 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:29.831120 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:29.831298 (+ 178us) server_negotiation.cc:407] Connection header received
0808 07:05:29.831829 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:29.831831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:29.831844 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:29.831898 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:29.832884 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:29.833497 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:29.834838 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:29.835055 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:29.835111 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:29.837303 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:29.837305 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:29.837305 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:29.837312 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:29.838563 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:29.838912 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:29.838912 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:29.838913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:29.838972 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:29.839172 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:29.839174 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:29.839174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:29.839287 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:29.839340 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:29.839604 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 07:05:29.839681 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 07:05:29.839844 7450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:29.831014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:39585)
0808 07:05:29.831176 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:29.831215 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:29.831723 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:29.831971 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:29.831974 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:29.832548 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:29.832754 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:29.832758 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:29.833580 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:29.833581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:29.834749 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:29.834752 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:29.835129 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:29.835130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:29.835272 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:29.835819 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:29.835830 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:29.837211 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:29.838632 (+ 1421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:29.838638 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:29.838641 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:29.838854 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:29.839017 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:29.839018 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:29.839018 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:29.839114 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:29.839335 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:29.839338 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:29.839457 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 07:05:29.839543 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 07:05:29.839669 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260808 07:05:29.840327 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 7249
I20260808 07:05:29.840317 7446 heartbeater.cc:347] Connected to a master server at 127.29.82.126:43645
I20260808 07:05:29.840425 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:29.840428 7446 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:29.840626 7446 heartbeater.cc:511] Master 127.29.82.126:43645 requested a full tablet report, sending...
I20260808 07:05:29.840632 30025 external_mini_cluster.cc:1428] Setting key 1b66c1a8ef45046e897bf613ef451720
I20260808 07:05:29.841059 6748 ts_manager.cc:194] Registered new tserver with Master: e6cdcf6d8bd24de4aad96397913d3f6b (127.29.82.67:39831)
I20260808 07:05:29.841507 6748 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:39585
I20260808 07:05:29.842147 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.29.82.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.82.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.82.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.125.keytab.
Entry for principal oryx/127.29.82.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.125.keytab.
I20260808 07:05:29.880535 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.125:33931
--webserver_interface=127.29.82.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.125.keytab
--principal=oryx/127.29.82.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:45293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:43645,127.29.82.125:33931
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:29.963541 7454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:29.963762 7454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:29.963793 7454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:29.964995 7454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:29.965044 7454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:29.965062 7454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:29.965078 7454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:29.965093 7454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:29.966683 7454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:45293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:43645,127.29.82.125:33931
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.125.keytab
--principal=oryx/127.29.82.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.125:33931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.82.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
W20260808 07:05:29.966817 7454 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.29.82.126:43645,127.29.82.125:33931'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 07:05:29.966976 7454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:29.967195 7454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:29.972102 7463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:29.972182 7454 server_base.cc:1034] running on GCE node
W20260808 07:05:29.972114 7467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:29.972141 7464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:29.972569 7454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:29.972900 7454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:29.974053 7454 hybrid_clock.cc:648] HybridClock initialized: now 1786172729974035 us; error 33 us; skew 500 ppm
Aug 08 07:05:29 dist-test-slave-rmhg krb5kdc[6683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:29.976508 7454 init.cc:377] Logged in from keytab as oryx/127.29.82.125@KRBTEST.COM (short username oryx)
I20260808 07:05:29.976979 7454 webserver.cc:460] Webserver started at http://127.29.82.125:38835/ using document root <none> and password file <none>
I20260808 07:05:29.977242 7454 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:29.977295 7454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:29.977419 7454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:29.978494 7454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/data/instance:
uuid: "a2cc406b6ed44508ad53d97451bb5171"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "5139054786af3ef288145cc5cdfe7cc2"
server_key_iv: "19608c0040427073b111e6e6091ac769"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.978850 7454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/wal/instance:
uuid: "a2cc406b6ed44508ad53d97451bb5171"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "5139054786af3ef288145cc5cdfe7cc2"
server_key_iv: "19608c0040427073b111e6e6091ac769"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.980159 7454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:29.980800 7474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:29.980970 7454 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:29.981050 7454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/wal
uuid: "a2cc406b6ed44508ad53d97451bb5171"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "5139054786af3ef288145cc5cdfe7cc2"
server_key_iv: "19608c0040427073b111e6e6091ac769"
server_key_version: "encryptionkey@0"
I20260808 07:05:29.981112 7454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:29.993667 7454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:29.995555 7454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:29.995700 7454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:29.999492 7454 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.125:33931
I20260808 07:05:29.999531 7563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.125:33931 every 8 connection(s)
I20260808 07:05:29.999869 7454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/data/info.pb
I20260808 07:05:30.000953 7564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:30.002555 7564 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:05:30.006304 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 7454
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.125@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.82.125@KRBTEST.COM
I20260808 07:05:30.011759 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.003263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53826 (local address 127.29.82.126:43645)
0808 07:05:30.003343 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.003346 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.003550 (+ 204us) server_negotiation.cc:407] Connection header received
0808 07:05:30.004017 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.004018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.004030 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.004081 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.004685 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.005260 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.006331 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.006568 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.006650 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.008894 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.008895 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.008896 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.008904 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.010377 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.010756 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.010757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.010758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.010811 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.011044 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.011045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.011046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.011196 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.011256 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.011559 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.011661 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 07:05:30.011811 7566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.003245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:53826)
0808 07:05:30.003421 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.003459 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.003920 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.004150 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.004154 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.004402 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.004618 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.004622 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.005359 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.005360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.006244 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.006247 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.006661 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.006662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.006803 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.007366 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.007375 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.008788 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.010452 (+ 1664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.010458 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.010460 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.010687 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.010865 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.010866 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.010866 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.010986 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.011255 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.011262 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.011400 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.011512 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.011649 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
I20260808 07:05:30.012620 7564 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:05:30.014640 7571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.006803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33386 (local address 127.29.82.125:33931)
0808 07:05:30.006979 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.006984 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.007007 (+ 23us) server_negotiation.cc:407] Connection header received
0808 07:05:30.007042 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.007044 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.007065 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.007129 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.007750 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.008463 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.009271 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.009726 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.009792 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.011910 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.011919 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.011919 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.011926 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.013597 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.013966 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.013968 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.013968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.014016 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.014182 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.014183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.014183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.014301 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.014422 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.014513 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.014570 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":99,"threads_started":1}
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.125@KRBTEST.COM for oryx/127.29.82.125@KRBTEST.COM
I20260808 07:05:30.019474 7566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.012973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33931 (local address 127.0.0.1:33392)
0808 07:05:30.013140 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.013175 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.013226 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.013339 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.013340 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.013568 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.013610 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.013612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.014389 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.014390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.015083 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.015086 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.015470 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.015471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.015528 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.015869 (+ 341us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.015874 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.016954 (+ 1080us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.018701 (+ 1747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.018702 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.018702 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.018850 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.018986 (+ 136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.018986 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.018986 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.019027 (+ 41us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.019218 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.019219 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.019261 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.019323 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.019395 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152}
I20260808 07:05:30.019554 7572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.013029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33392 (local address 127.29.82.125:33931)
0808 07:05:30.013189 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.013191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.013212 (+ 21us) server_negotiation.cc:407] Connection header received
0808 07:05:30.013266 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.013267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.013275 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.013332 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.013681 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.014319 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.015158 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.015409 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.015459 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.017038 (+ 1579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.017040 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.017040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.017046 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.018631 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.018904 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.018904 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.018905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.018950 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.019057 (+ 107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.019058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.019058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.019172 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.019214 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.019337 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.019437 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":141,"thread_start_us":80,"threads_started":1}
I20260808 07:05:30.020758 7564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: Bootstrap starting.
I20260808 07:05:30.021409 7564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:30.021664 7564 log.cc:824] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:30.022382 7564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: No bootstrap required, opened a new log
I20260808 07:05:30.023746 7564 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } }
I20260808 07:05:30.023866 7564 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:30.023900 7564 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2cc406b6ed44508ad53d97451bb5171, State: Initialized, Role: FOLLOWER
I20260808 07:05:30.024024 7564 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } }
I20260808 07:05:30.024325 7564 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:30.024296 7576 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } } }
I20260808 07:05:30.024379 7576 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:05:30.025998 7596 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:05:30.026065 7596 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:05:30.027897 7454 master_runner.cc:428] Detected that this master a2cc406b6ed44508ad53d97451bb5171 is joining an existing cluster
I20260808 07:05:30.027973 7454 master_runner.cc:432] Initiating AddMaster RPC to add 127.29.82.125:33931
I20260808 07:05:30.036056 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.028930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53828 (local address 127.29.82.126:43645)
0808 07:05:30.028972 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.028974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.029263 (+ 289us) server_negotiation.cc:407] Connection header received
0808 07:05:30.029337 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.029338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.029350 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.029392 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.029776 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.030566 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.031636 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.031936 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.032004 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.033212 (+ 1208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.033214 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.033214 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.033221 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.034783 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.035212 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.035213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.035214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.035274 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.035452 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.035453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.035453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.035586 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.035650 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.035881 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.035963 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:05:30.036274 7606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.029085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33931 (local address 127.0.0.1:33402)
0808 07:05:30.029822 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.029830 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.029887 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.030017 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.030017 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.030166 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.030211 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.030212 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.030905 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.030906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.031676 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.031678 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.032018 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.032019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.032078 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.032485 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.032490 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.032941 (+ 451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.034806 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.034806 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.034807 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.035169 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.035362 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.035363 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.035363 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.035417 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.035668 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.035669 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.035713 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.035766 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.035874 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"thread_start_us":86,"threads_started":1}
I20260808 07:05:30.036342 7605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.028865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:53828)
0808 07:05:30.029205 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.029216 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.029279 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.029405 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.029405 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.029595 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.029684 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.029687 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.030656 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.030657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.031553 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.031555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.032065 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.032066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.032135 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.032639 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.032643 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.033094 (+ 451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.034836 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.034837 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.034838 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.035150 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.035326 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.035327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.035327 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.035392 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.035649 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.035650 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.035706 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.035788 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.036120 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":182,"thread_start_us":91,"threads_started":1}
I20260808 07:05:30.036391 7572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.029127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33402 (local address 127.29.82.125:33931)
0808 07:05:30.029208 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.029210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.029890 (+ 680us) server_negotiation.cc:407] Connection header received
0808 07:05:30.029941 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.029941 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.029961 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.030000 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.030273 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.030828 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.031736 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.031936 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.031987 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.033014 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.033015 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.033016 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.033022 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.034710 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.035256 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.035257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.035257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.035301 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.035473 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.035474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.035474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.035588 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.035629 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.035806 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.035930 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":68}
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.126@KRBTEST.COM for oryx/127.29.82.125@KRBTEST.COM
I20260808 07:05:30.045619 7572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.038796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33418 (local address 127.29.82.125:33931)
0808 07:05:30.038835 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.038836 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.038973 (+ 137us) server_negotiation.cc:407] Connection header received
0808 07:05:30.039058 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.039059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.039068 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.039112 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.039490 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.039928 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.040655 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.040851 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.040903 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.042990 (+ 2087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.042992 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.042992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.042999 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.044465 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.044818 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.044820 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.044820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.044875 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.045048 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.045049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.045049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.045183 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.045237 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.045447 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.045526 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:05:30.045671 7609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.038732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33931 (local address 127.0.0.1:33418)
0808 07:05:30.038867 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.038910 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.038988 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.039116 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.039119 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.039377 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.039422 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.039423 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.039993 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.039994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.040584 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.040585 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.040907 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.040908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.040998 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.041428 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.041432 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.042910 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.044536 (+ 1626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.044546 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.044548 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.044751 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.044936 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.044936 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.044937 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.044997 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.045238 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.045247 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.045329 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.045410 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.045578 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":71,"threads_started":1}
I20260808 07:05:30.046347 6748 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.29.82.125:33931: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171"
member_type: NON_VOTER
last_known_addr {
host: "127.29.82.125"
port: 33931
}
attrs {
promote: true
}
}
dest_uuid: "8caf019b6be6444081601acfda7fb6fc"
cas_config_opid_index: -1
I20260808 07:05:30.046710 6748 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: NON_VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: true } }
I20260808 07:05:30.047209 7616 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER a2cc406b6ed44508ad53d97451bb5171 (127.29.82.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: NON_VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: true } } }
I20260808 07:05:30.047561 7522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:30.048240 7616 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.29.82.125:33931
I20260808 07:05:30.048295 7522 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Refusing update from remote peer 8caf019b6be6444081601acfda7fb6fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 07:05:30.048470 7454 master.cc:537] Master@127.29.82.125:33931 shutting down...
I20260808 07:05:30.048434 7614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "8caf019b6be6444081601acfda7fb6fc" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: NON_VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: true } } }
I20260808 07:05:30.048513 7614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:30.048609 7614 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: NON_VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 07:05:30.049463 6722 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 07:05:30.050907 6722 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc -> Peer a2cc406b6ed44508ad53d97451bb5171 (127.29.82.125:33931): Couldn't send request to peer a2cc406b6ed44508ad53d97451bb5171. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:05:30.051388 7454 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:30.051465 7454 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:30.051501 7454 tablet_replica.cc:330] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: stopping tablet replica
I20260808 07:05:30.063982 7454 master.cc:552] Master@127.29.82.125:33931 shutdown complete.
I20260808 07:05:30.064036 7454 master_runner.cc:305] Clearing existing system tablet
I20260808 07:05:30.064152 7454 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:30.064200 7454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:30.064795 7454 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:30.065335 7621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.065455 7454 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:30.065541 7454 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:05:30.065568 7454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/wal
uuid: "a2cc406b6ed44508ad53d97451bb5171"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "5139054786af3ef288145cc5cdfe7cc2"
server_key_iv: "19608c0040427073b111e6e6091ac769"
server_key_version: "encryptionkey@0"
I20260808 07:05:30.066401 7454 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:30.068094 7454 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 07:05:30.068167 7454 log.cc:1196] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 07:05:30.068370 7454 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: Deleting consensus metadata
I20260808 07:05:30.068504 7454 master_runner.cc:315] Copying system tablet from 127.29.82.126:43645
I20260808 07:05:30.069139 7454 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: tablet copy: Beginning tablet copy session from remote peer at address 127.29.82.126:43645
I20260808 07:05:30.075510 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.069594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53832 (local address 127.29.82.126:43645)
0808 07:05:30.069643 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.069645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.069733 (+ 88us) server_negotiation.cc:407] Connection header received
0808 07:05:30.069809 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.069811 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.069820 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.069868 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.070238 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.070744 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.071851 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.072050 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.072098 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.073249 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.073251 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.073251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.073258 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.074522 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.074877 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.074878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.074878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.074939 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.075103 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.075104 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.075104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.075202 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.075247 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.075378 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.075440 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:05:30.075585 7629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.069469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:53832)
0808 07:05:30.069666 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.069677 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.069748 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.069886 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.069887 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.070093 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.070164 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.070166 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.070816 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.070817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.071753 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.071755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.072113 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.072114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.072182 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.072754 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.072759 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.073143 (+ 384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.074595 (+ 1452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.074597 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.074597 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.074811 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.074991 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.074992 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.074993 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.075054 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.075251 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.075251 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.075295 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.075359 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.075460 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":71,"threads_started":1}
I20260808 07:05:30.075924 6783 tablet_copy_service.cc:140] P 8caf019b6be6444081601acfda7fb6fc: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a2cc406b6ed44508ad53d97451bb5171 ({username='oryx', principal='oryx/127.29.82.125@KRBTEST.COM'} at 127.0.0.1:53832)
I20260808 07:05:30.076036 6783 tablet_copy_service.cc:161] P 8caf019b6be6444081601acfda7fb6fc: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a2cc406b6ed44508ad53d97451bb5171 at {username='oryx', principal='oryx/127.29.82.125@KRBTEST.COM'} at 127.0.0.1:53832: session id = a2cc406b6ed44508ad53d97451bb5171-00000000000000000000000000000000
I20260808 07:05:30.076903 6783 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 07:05:30.077574 7454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 07:05:30.078500 7454 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: tablet copy: Starting download of 0 data blocks...
I20260808 07:05:30.078640 7454 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: tablet copy: Starting download of 1 WAL segments...
I20260808 07:05:30.079506 7454 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 07:05:30.080283 6783 tablet_copy_service.cc:342] P 8caf019b6be6444081601acfda7fb6fc: Request end of tablet copy session a2cc406b6ed44508ad53d97451bb5171-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.29.82.125@KRBTEST.COM'} at 127.0.0.1:53832
I20260808 07:05:30.080333 6783 tablet_copy_service.cc:433] P 8caf019b6be6444081601acfda7fb6fc: ending tablet copy session a2cc406b6ed44508ad53d97451bb5171-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a2cc406b6ed44508ad53d97451bb5171
I20260808 07:05:30.082907 7454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:30.084110 7631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:30.084151 7630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:30.084138 7633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:30.084321 7454 server_base.cc:1034] running on GCE node
I20260808 07:05:30.084622 7454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:30.084766 7454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:30.085884 7454 hybrid_clock.cc:648] HybridClock initialized: now 1786172730085874 us; error 30 us; skew 500 ppm
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:30.087236 7454 init.cc:377] Logged in from keytab as oryx/127.29.82.125@KRBTEST.COM (short username oryx)
I20260808 07:05:30.087513 7454 webserver.cc:460] Webserver started at http://127.29.82.125:42303/ using document root <none> and password file <none>
I20260808 07:05:30.087626 7454 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:30.087661 7454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:30.088371 7454 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:30.088966 7645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.089110 7454 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.089177 7454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/wal
uuid: "a2cc406b6ed44508ad53d97451bb5171"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "5139054786af3ef288145cc5cdfe7cc2"
server_key_iv: "19608c0040427073b111e6e6091ac769"
server_key_version: "encryptionkey@0"
I20260808 07:05:30.089229 7454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:30.111969 7454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:30.113605 7454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:30.116210 7454 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.125:33931
I20260808 07:05:30.116436 7727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.125:33931 every 8 connection(s)
I20260808 07:05:30.116576 7454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-1/data/info.pb
I20260808 07:05:30.117513 7731 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:05:30.118016 7731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: Bootstrap starting.
I20260808 07:05:30.120810 7731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:05:30.121022 7731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: Bootstrap complete.
I20260808 07:05:30.121277 7731 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: NON_VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: true } }
I20260808 07:05:30.121371 7731 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a2cc406b6ed44508ad53d97451bb5171, State: Initialized, Role: LEARNER
I20260808 07:05:30.121409 7731 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: NON_VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: true } }
I20260808 07:05:30.121665 7731 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:30.121635 7736 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: NON_VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: true } } }
I20260808 07:05:30.122141 7736 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [sys.catalog]: This master's current role is: LEARNER
I20260808 07:05:30.123190 7757 catalog_manager.cc:1259] Loaded cluster ID: 438266a4eca24c028c06bbd2d25dce84
I20260808 07:05:30.123240 7757 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: loading cluster ID for follower catalog manager: success
I20260808 07:05:30.124322 7757 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: acquiring CA information for follower catalog manager: success
I20260808 07:05:30.124689 7757 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:05:30.125231 7729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.116614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33440 (local address 127.29.82.125:33931)
0808 07:05:30.116756 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.116758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.116767 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:05:30.116794 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.116795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.116806 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.116893 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.117657 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.118702 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.119669 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.119999 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.120077 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.121579 (+ 1502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.121580 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.121581 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.121589 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.123464 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.124156 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.124157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.124157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.124220 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.124446 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.124447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.124447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.124585 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.124677 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.125042 (+ 365us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.125125 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
WARNING: no policy specified for oryx/127.29.82.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.82.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.82.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.124.keytab.
Entry for principal oryx/127.29.82.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.124.keytab.
I20260808 07:05:30.152766 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.124:33505
--webserver_interface=127.29.82.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.124.keytab
--principal=oryx/127.29.82.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:45293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:43645,127.29.82.125:33931,127.29.82.124:33505
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:30.237143 7761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:30.237370 7761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:30.237390 7761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:30.238545 7761 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:30.238581 7761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:30.238595 7761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:30.238605 7761 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:30.238616 7761 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:30.240108 7761 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:45293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:43645,127.29.82.125:33931,127.29.82.124:33505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.124.keytab
--principal=oryx/127.29.82.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.124:33505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.82.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:30.240334 7761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:30.240546 7761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:30.245282 7772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:30.245261 7771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:30.245299 7775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:30.245446 7761 server_base.cc:1034] running on GCE node
I20260808 07:05:30.245846 7761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:30.246124 7761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:30.247267 7761 hybrid_clock.cc:648] HybridClock initialized: now 1786172730247251 us; error 30 us; skew 500 ppm
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:30.249936 7761 init.cc:377] Logged in from keytab as oryx/127.29.82.124@KRBTEST.COM (short username oryx)
I20260808 07:05:30.250346 7761 webserver.cc:460] Webserver started at http://127.29.82.124:39881/ using document root <none> and password file <none>
I20260808 07:05:30.250542 7761 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:30.250581 7761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:30.250675 7761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:30.251672 7761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/data/instance:
uuid: "2a22889798274e50842d9218c2db742b"
format_stamp: "Formatted at 2026-08-08 07:05:30 on dist-test-slave-rmhg"
server_key: "154c804a6ace78d746e8dfcdf2a4641c"
server_key_iv: "7cf34ea16241d70cb0b561fe6e568771"
server_key_version: "encryptionkey@0"
I20260808 07:05:30.251963 7761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/wal/instance:
uuid: "2a22889798274e50842d9218c2db742b"
format_stamp: "Formatted at 2026-08-08 07:05:30 on dist-test-slave-rmhg"
server_key: "154c804a6ace78d746e8dfcdf2a4641c"
server_key_iv: "7cf34ea16241d70cb0b561fe6e568771"
server_key_version: "encryptionkey@0"
I20260808 07:05:30.253209 7761 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:05:30.253960 7785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.254119 7761 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:30.254207 7761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/wal
uuid: "2a22889798274e50842d9218c2db742b"
format_stamp: "Formatted at 2026-08-08 07:05:30 on dist-test-slave-rmhg"
server_key: "154c804a6ace78d746e8dfcdf2a4641c"
server_key_iv: "7cf34ea16241d70cb0b561fe6e568771"
server_key_version: "encryptionkey@0"
I20260808 07:05:30.254261 7761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:30.267896 7761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:30.269852 7761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:30.269960 7761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:30.273861 7761 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.124:33505
I20260808 07:05:30.273900 7858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.124:33505 every 8 connection(s)
I20260808 07:05:30.274214 7761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/data/info.pb
I20260808 07:05:30.275195 7860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:30.276765 7860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:05:30.278692 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 7761
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.124@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.82.124@KRBTEST.COM
I20260808 07:05:30.286854 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.277606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53844 (local address 127.29.82.126:43645)
0808 07:05:30.277668 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.277670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.277769 (+ 99us) server_negotiation.cc:407] Connection header received
0808 07:05:30.278243 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.278244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.278254 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.278310 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.278989 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.279672 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.280805 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.281110 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.281192 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.283660 (+ 2468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.283662 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.283663 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.283672 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.285236 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.285779 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.285781 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.285782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.285869 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.286176 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.286178 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.286178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.286330 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.286407 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.286714 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.286782 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 07:05:30.287127 7862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.277458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:53844)
0808 07:05:30.277653 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.277696 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.278165 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.278367 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.278370 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.278657 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.278897 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.278902 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.279778 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.279779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.280708 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.280717 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.281228 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.281230 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.281372 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.281878 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.281887 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.283540 (+ 1653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.285347 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.285355 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.285358 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.285686 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.285973 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.285974 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.285975 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.286101 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.286420 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.286427 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.286567 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.286688 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.286854 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":93,"threads_started":1}
I20260808 07:05:30.287681 7860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:05:30.287819 7863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.279184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35886 (local address 127.29.82.124:33505)
0808 07:05:30.279347 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.279352 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.279373 (+ 21us) server_negotiation.cc:407] Connection header received
0808 07:05:30.279393 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.279395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.279415 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.279490 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.280154 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.280936 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.281861 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.282171 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.282225 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.284799 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.284808 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.284809 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.284816 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.286569 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.286965 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.286968 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.286969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.287029 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.287258 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.287259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.287260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.287428 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.287579 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.287648 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.287716 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":97,"threads_started":1}
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.124@KRBTEST.COM for oryx/127.29.82.125@KRBTEST.COM
I20260808 07:05:30.293705 7862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.287934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33931 (local address 127.0.0.1:33444)
0808 07:05:30.287977 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.287988 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.288032 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.288191 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.288192 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.288316 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.288347 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.288348 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.289046 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.289047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.289587 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.289588 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.289894 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.289895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.289933 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.290315 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.290320 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.291398 (+ 1078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.292808 (+ 1410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.292809 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.292809 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.292959 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.293144 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.293145 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.293145 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.293239 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.293483 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.293484 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.293520 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.293569 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.293642 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 07:05:30.293720 7729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.288011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33444 (local address 127.29.82.125:33931)
0808 07:05:30.288054 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.288056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.288063 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:05:30.288086 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.288086 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.288095 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.288145 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.288419 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.288956 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.289649 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.289846 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.289893 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.291483 (+ 1590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.291485 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.291485 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.291493 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.292738 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.293018 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.293019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.293019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.293070 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.293305 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.293306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.293306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.293431 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.293484 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.293588 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.293658 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:05:30.294113 7860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.124" port: 33505 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.124@KRBTEST.COM for oryx/127.29.82.124@KRBTEST.COM
I20260808 07:05:30.299728 7862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.294349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:33505 (local address 127.0.0.1:35890)
0808 07:05:30.294388 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.294399 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.294435 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.294570 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.294571 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.294685 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.294712 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.294713 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.295293 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.295294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.295769 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.295770 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.296099 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.296100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.296141 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.296453 (+ 312us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.296457 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.297619 (+ 1162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.298865 (+ 1246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.298866 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.298866 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.299021 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.299176 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.299177 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.299177 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.299228 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.299427 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.299428 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.299463 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.299523 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.299620 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 07:05:30.299774 7863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.294394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35890 (local address 127.29.82.124:33505)
0808 07:05:30.294436 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.294437 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.294490 (+ 53us) server_negotiation.cc:407] Connection header received
0808 07:05:30.294507 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.294508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.294518 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.294562 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.294770 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.295230 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.295833 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.296045 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.296097 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.297695 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.297696 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.297696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.297702 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.298792 (+ 1090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.299077 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.299078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.299078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.299125 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.299276 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.299276 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.299277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.299375 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.299427 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.299551 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.299668 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":28}
I20260808 07:05:30.301397 7860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: Bootstrap starting.
I20260808 07:05:30.302292 7860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:30.302587 7860 log.cc:824] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:30.303292 7860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: No bootstrap required, opened a new log
I20260808 07:05:30.304844 7860 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 33505 } }
I20260808 07:05:30.304972 7860 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:30.304998 7860 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a22889798274e50842d9218c2db742b, State: Initialized, Role: FOLLOWER
I20260808 07:05:30.305116 7860 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 33505 } }
I20260808 07:05:30.305435 7867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 33505 } } }
I20260808 07:05:30.305508 7860 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:30.305531 7867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:05:30.307227 7881 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:05:30.307287 7881 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:05:30.309302 7761 master_runner.cc:428] Detected that this master 2a22889798274e50842d9218c2db742b is joining an existing cluster
I20260808 07:05:30.309355 7761 master_runner.cc:432] Initiating AddMaster RPC to add 127.29.82.124:33505
I20260808 07:05:30.317423 7894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.310876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33931 (local address 127.0.0.1:33448)
0808 07:05:30.311158 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.311167 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.311257 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.311421 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.311422 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.311625 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.311693 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.311695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.312562 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.312563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.313410 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.313412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.314178 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.314179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.314251 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.314618 (+ 367us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.314623 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.314930 (+ 307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.316419 (+ 1489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.316421 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.316421 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.316586 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.316774 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.316775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.316776 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.316831 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.317060 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.317061 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.317119 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.317198 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.317312 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":72,"threads_started":1}
I20260808 07:05:30.317413 7729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.311047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33448 (local address 127.29.82.125:33931)
0808 07:05:30.311086 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.311089 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.311216 (+ 127us) server_negotiation.cc:407] Connection header received
0808 07:05:30.311326 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.311327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.311337 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.311364 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.311781 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.312474 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.313496 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.313769 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.314099 (+ 330us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.315041 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.315042 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.315043 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.315050 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.316342 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.316649 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.316650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.316651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.316710 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.316882 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.316882 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.316883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.317003 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.317061 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.317241 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.317320 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:05:30.332612 7863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.310619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35900 (local address 127.29.82.124:33505)
0808 07:05:30.310653 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.310655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.310841 (+ 186us) server_negotiation.cc:407] Connection header received
0808 07:05:30.310924 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.310925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.310935 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.310959 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.311432 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.312143 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.313133 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.313457 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.313507 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.329710 (+ 16203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.329712 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.329712 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.329722 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.331328 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.331710 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.331711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.331712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.331769 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.331982 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.331983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.331984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.332129 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.332187 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.332345 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.332518 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":87,"server-negotiator.queue_time_us":18}
I20260808 07:05:30.332773 7892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.310458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:33505 (local address 127.0.0.1:35900)
0808 07:05:30.310787 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.310796 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.310863 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.311012 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.311012 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.311274 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.311361 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.311363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.312218 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.312219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.313056 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.313058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.313585 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.313586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.313641 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.314094 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.314099 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.329580 (+ 15481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.331430 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.331431 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.331432 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.331637 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.331831 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.331832 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.331832 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.331895 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.332187 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.332188 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.332245 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.332308 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.332440 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":102,"threads_started":1}
I20260808 07:05:30.333117 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.310537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53852 (local address 127.29.82.126:43645)
0808 07:05:30.310580 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.310582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.310775 (+ 193us) server_negotiation.cc:407] Connection header received
0808 07:05:30.310881 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.310882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.310894 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.310923 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.311438 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.312196 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.313390 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.313702 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.313744 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.330373 (+ 16629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.330376 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.330377 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.330385 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.331888 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.332246 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.332247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.332248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.332310 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.332513 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.332514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.332514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.332648 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.332688 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.332942 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.333032 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:05:30.333535 7891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.310456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:53852)
0808 07:05:30.310698 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.310711 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.310807 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.310992 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.310992 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.311265 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.311344 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.311346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.312289 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.312290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.313289 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.313292 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.313821 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.313822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.313888 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.329819 (+ 15931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.329824 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.330279 (+ 455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.331967 (+ 1688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.331968 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.331968 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.332181 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.332375 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.332376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.332376 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.332441 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.332734 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.332735 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.332777 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.333272 (+ 495us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.333435 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":32,"spinlock_wait_cycles":384,"thread_start_us":277,"threads_started":1}
I20260808 07:05:30.339084 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 6847
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172729, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.126@KRBTEST.COM for oryx/127.29.82.124@KRBTEST.COM
I20260808 07:05:30.355021 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:39795
--local_ip_for_outbound_sockets=127.29.82.65
--tserver_master_addrs=127.29.82.126:43645
--webserver_port=38609
--webserver_interface=127.29.82.65
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.65.keytab
--principal=oryx/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:45293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.29.82.126:43645,127.29.82.125:33931
--tserver_master_addrs=127.29.82.126:43645,127.29.82.125:33931,127.29.82.124:33505 with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:05:30.357277 7863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.335564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35902 (local address 127.29.82.124:33505)
0808 07:05:30.335600 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.335601 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.335609 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:30.335639 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.335640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.335649 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.335708 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.335939 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.336667 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.337407 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.337707 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.337776 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.354023 (+ 16247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.354025 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.354026 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.354037 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.355833 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.356300 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.356301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.356302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.356371 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.356605 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.356606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.356606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.356788 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.356851 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.357062 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.357190 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:05:30.357292 7609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.335463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:33505 (local address 127.0.0.1:35902)
0808 07:05:30.335517 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.335526 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.335563 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.335709 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.335709 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.335838 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.335880 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.335881 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.336741 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.336742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.337344 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.337346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.337771 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.337771 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.337818 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.338165 (+ 347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.338168 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.353842 (+ 15674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.355949 (+ 2107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.355951 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.355952 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.356224 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.356441 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.356442 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.356443 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.356524 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.356867 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.356869 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.356935 (+ 66us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.357021 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.357195 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 07:05:30.357997 6748 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.29.82.124:33505: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "2a22889798274e50842d9218c2db742b"
member_type: NON_VOTER
last_known_addr {
host: "127.29.82.124"
port: 33505
}
attrs {
promote: true
}
}
dest_uuid: "8caf019b6be6444081601acfda7fb6fc"
cas_config_opid_index: 5
I20260808 07:05:30.358265 6748 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: NON_VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: true } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } }
I20260808 07:05:30.358636 7614 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 2a22889798274e50842d9218c2db742b (127.29.82.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: NON_VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: true } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } } }
I20260808 07:05:30.359686 7614 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.29.82.124:33505
I20260808 07:05:30.359767 7614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "8caf019b6be6444081601acfda7fb6fc" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: NON_VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: true } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } } }
I20260808 07:05:30.359829 7614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:30.360309 7761 master.cc:537] Master@127.29.82.124:33505 shutting down...
I20260808 07:05:30.360464 7825 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:30.361539 7825 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [term 1 FOLLOWER]: Refusing update from remote peer 8caf019b6be6444081601acfda7fb6fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 07:05:30.361945 7616 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 07:05:30.362699 6727 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc -> Peer 2a22889798274e50842d9218c2db742b (127.29.82.124:33505): Couldn't send request to peer 2a22889798274e50842d9218c2db742b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:05:30.364920 7761 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:30.365012 7761 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:30.365056 7761 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: stopping tablet replica
I20260808 07:05:30.367134 7729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.359928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33454 (local address 127.29.82.125:33931)
0808 07:05:30.359985 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.359988 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.359998 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:05:30.360024 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.360025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.360052 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.360118 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:30.363423 (+ 3305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.364187 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.365992 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.366595 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.366649 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.366737 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.367012 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.367063 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:05:30.367364 7609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.358774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33931 (local address 127.0.0.1:33454)
0808 07:05:30.358913 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.358923 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.358954 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.360182 (+ 1228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.360184 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.360185 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:30.360233 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.360235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.364527 (+ 4292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.364528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.365846 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.365851 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.366802 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.366804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.366876 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.366905 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.367248 (+ 343us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.367299 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123}
I20260808 07:05:30.367847 7680 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 LEARNER]: Refusing update from remote peer 8caf019b6be6444081601acfda7fb6fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 07:05:30.368088 7616 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: NON_VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 07:05:30.368695 7680 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 2a22889798274e50842d9218c2db742b (127.29.82.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: NON_VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: true } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } } }
I20260808 07:05:30.369948 7736 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8caf019b6be6444081601acfda7fb6fc. Latest consensus state: current_term: 1 leader_uuid: "8caf019b6be6444081601acfda7fb6fc" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: NON_VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: true } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } } }
I20260808 07:05:30.370033 7736 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [sys.catalog]: This master's current role is: LEARNER
I20260808 07:05:30.370064 7736 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8caf019b6be6444081601acfda7fb6fc" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: NON_VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: true } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } } }
I20260808 07:05:30.370106 7736 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [sys.catalog]: This master's current role is: LEARNER
I20260808 07:05:30.370344 7616 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc: attempting to promote NON_VOTER a2cc406b6ed44508ad53d97451bb5171 to VOTER
I20260808 07:05:30.370549 7616 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } }
I20260808 07:05:30.371059 7609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.370935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:33505 (local address 127.0.0.1:35918)
0808 07:05:30.370986 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.371030 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:33505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260808 07:05:30.371100 7680 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 LEARNER]: Refusing update from remote peer 8caf019b6be6444081601acfda7fb6fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 07:05:30.371273 7900 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 07:05:30.371477 7609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.371398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:33505 (local address 127.0.0.1:35920)
0808 07:05:30.371429 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.371450 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:33505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260808 07:05:30.371760 6727 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc -> Peer 2a22889798274e50842d9218c2db742b (127.29.82.124:33505): Couldn't send request to peer 2a22889798274e50842d9218c2db742b. Status: Network error: Client connection negotiation failed: client connection to 127.29.82.124:33505: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 07:05:30.371991 7614 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, a2cc406b6ed44508ad53d97451bb5171 (127.29.82.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } } }
I20260808 07:05:30.372854 7614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "8caf019b6be6444081601acfda7fb6fc" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } } }
I20260808 07:05:30.372921 7614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:30.372872 7900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8caf019b6be6444081601acfda7fb6fc" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } } }
I20260808 07:05:30.372953 7900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:30.373222 7680 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, a2cc406b6ed44508ad53d97451bb5171 (127.29.82.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } } }
I20260808 07:05:30.374258 7898 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8caf019b6be6444081601acfda7fb6fc" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } } }
I20260808 07:05:30.374346 7898 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:05:30.378108 7761 master.cc:552] Master@127.29.82.124:33505 shutdown complete.
I20260808 07:05:30.378154 7761 master_runner.cc:305] Clearing existing system tablet
I20260808 07:05:30.378288 7761 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:30.378334 7761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:30.379050 7761 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:30.380777 7902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.380913 7761 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:30.380954 7761 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:05:30.380975 7761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/wal
uuid: "2a22889798274e50842d9218c2db742b"
format_stamp: "Formatted at 2026-08-08 07:05:30 on dist-test-slave-rmhg"
server_key: "154c804a6ace78d746e8dfcdf2a4641c"
server_key_iv: "7cf34ea16241d70cb0b561fe6e568771"
server_key_version: "encryptionkey@0"
I20260808 07:05:30.382175 7761 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:30.384570 7761 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 07:05:30.384752 7761 log.cc:1196] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 07:05:30.385044 7761 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: Deleting consensus metadata
I20260808 07:05:30.385222 7761 master_runner.cc:315] Copying system tablet from 127.29.82.126:43645
I20260808 07:05:30.385901 7761 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: tablet copy: Beginning tablet copy session from remote peer at address 127.29.82.126:43645
I20260808 07:05:30.393326 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.386294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53862 (local address 127.29.82.126:43645)
0808 07:05:30.386346 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.386349 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.386488 (+ 139us) server_negotiation.cc:407] Connection header received
0808 07:05:30.386549 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.386551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.386563 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.386615 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.386976 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.387741 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.388766 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.389052 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.389130 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.390266 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.390268 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.390268 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.390277 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.392031 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.392418 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.392419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.392419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.392486 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.392712 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.392713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.392713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.392855 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.392929 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.393112 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.393226 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 07:05:30.393328 7909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.386214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:53862)
0808 07:05:30.386399 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.386410 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.386485 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.386631 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.386632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.386834 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.386893 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.386895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.387832 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.387833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.388669 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.388672 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.389135 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.389137 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.389223 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.389716 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.389721 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.390173 (+ 452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.392117 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.392118 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.392119 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.392337 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.392565 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.392566 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.392566 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.392639 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.392924 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.392925 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.392996 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.393072 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.393232 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":72,"threads_started":1}
I20260808 07:05:30.393946 6783 tablet_copy_service.cc:140] P 8caf019b6be6444081601acfda7fb6fc: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 2a22889798274e50842d9218c2db742b ({username='oryx', principal='oryx/127.29.82.124@KRBTEST.COM'} at 127.0.0.1:53862)
I20260808 07:05:30.394016 6783 tablet_copy_service.cc:161] P 8caf019b6be6444081601acfda7fb6fc: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 2a22889798274e50842d9218c2db742b at {username='oryx', principal='oryx/127.29.82.124@KRBTEST.COM'} at 127.0.0.1:53862: session id = 2a22889798274e50842d9218c2db742b-00000000000000000000000000000000
I20260808 07:05:30.394652 6783 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 07:05:30.395192 7761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 07:05:30.396603 7761 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: tablet copy: Starting download of 0 data blocks...
I20260808 07:05:30.396749 7761 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: tablet copy: Starting download of 1 WAL segments...
I20260808 07:05:30.397544 7761 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 07:05:30.398445 6783 tablet_copy_service.cc:342] P 8caf019b6be6444081601acfda7fb6fc: Request end of tablet copy session 2a22889798274e50842d9218c2db742b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.29.82.124@KRBTEST.COM'} at 127.0.0.1:53862
I20260808 07:05:30.398554 6783 tablet_copy_service.cc:433] P 8caf019b6be6444081601acfda7fb6fc: ending tablet copy session 2a22889798274e50842d9218c2db742b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 2a22889798274e50842d9218c2db742b
I20260808 07:05:30.401054 7761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:30.402297 7910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:30.406209 7914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:30.406411 7911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:30.409217 7761 server_base.cc:1034] running on GCE node
I20260808 07:05:30.409335 7761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:30.409492 7761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:30.410629 7761 hybrid_clock.cc:648] HybridClock initialized: now 1786172730410623 us; error 27 us; skew 500 ppm
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:30.412174 7761 init.cc:377] Logged in from keytab as oryx/127.29.82.124@KRBTEST.COM (short username oryx)
I20260808 07:05:30.412469 7761 webserver.cc:460] Webserver started at http://127.29.82.124:33181/ using document root <none> and password file <none>
I20260808 07:05:30.412601 7761 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:30.412640 7761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:30.417435 7761 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.000s sys 0.001s
I20260808 07:05:30.418061 7923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.418211 7761 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:30.418268 7761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/wal
uuid: "2a22889798274e50842d9218c2db742b"
format_stamp: "Formatted at 2026-08-08 07:05:30 on dist-test-slave-rmhg"
server_key: "154c804a6ace78d746e8dfcdf2a4641c"
server_key_iv: "7cf34ea16241d70cb0b561fe6e568771"
server_key_version: "encryptionkey@0"
I20260808 07:05:30.418331 7761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:30.429716 7761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:30.431684 7761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:30.434933 7761 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.124:33505
I20260808 07:05:30.434974 8006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.124:33505 every 8 connection(s)
I20260808 07:05:30.435303 7761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/master-2/data/info.pb
I20260808 07:05:30.436285 8007 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:05:30.436941 8007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: Bootstrap starting.
I20260808 07:05:30.440182 8007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:05:30.440428 8007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: Bootstrap complete.
I20260808 07:05:30.440652 8007 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } }
I20260808 07:05:30.440749 8007 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2a22889798274e50842d9218c2db742b, State: Initialized, Role: LEARNER
I20260808 07:05:30.440785 8007 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } }
I20260808 07:05:30.440986 8007 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:30.442625 8030 catalog_manager.cc:1259] Loaded cluster ID: 438266a4eca24c028c06bbd2d25dce84
I20260808 07:05:30.442674 8030 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: loading cluster ID for follower catalog manager: success
I20260808 07:05:30.444358 8030 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: acquiring CA information for follower catalog manager: success
I20260808 07:05:30.444698 8030 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:05:30.445293 8013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } } }
I20260808 07:05:30.445464 8013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a22889798274e50842d9218c2db742b [sys.catalog]: This master's current role is: LEARNER
W20260808 07:05:30.457670 7896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:30.457890 7896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:30.457914 7896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:30.459107 7896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:30.459151 7896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:30.459180 7896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:05:30.460767 7896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:45293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.65.keytab
--principal=oryx/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:39795
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=38609
--tserver_master_addrs=127.29.82.126:43645,127.29.82.125:33931,127.29.82.124:33505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:30.461009 7896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:30.461280 7896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:30.466536 8039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:30.466600 8041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:30.466715 7896 server_base.cc:1034] running on GCE node
W20260808 07:05:30.466537 8038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:30.466957 7896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:30.467203 7896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:30.468354 7896 hybrid_clock.cc:648] HybridClock initialized: now 1786172730468336 us; error 29 us; skew 500 ppm
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:30.470958 7896 init.cc:377] Logged in from keytab as oryx/127.29.82.65@KRBTEST.COM (short username oryx)
I20260808 07:05:30.471422 7896 webserver.cc:460] Webserver started at http://127.29.82.65:38609/ using document root <none> and password file <none>
I20260808 07:05:30.471630 7896 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:30.471716 7896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:30.473137 7896 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:30.473767 8051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.473919 7896 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.474015 7896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "d19002f56a194dc7b126516d01a01cce"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "148e692b390daf266afb130e9f05c441"
server_key_iv: "56a99de5cbe644157b39697a83155462"
server_key_version: "encryptionkey@0"
I20260808 07:05:30.474362 7896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:30.485543 7896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:30.487496 7896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:30.487639 7896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:30.487882 7896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:30.488207 7896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:30.488243 7896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.488273 7896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:30.488291 7896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.494652 7896 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:39795
I20260808 07:05:30.494781 8226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:39795 every 8 connection(s)
I20260808 07:05:30.495071 7896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
I20260808 07:05:30.502244 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 7896
I20260808 07:05:30.502413 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 7049
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.125@KRBTEST.COM
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.124@KRBTEST.COM
I20260808 07:05:30.511770 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.495976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:60357 (local address 127.29.82.126:43645)
0808 07:05:30.496034 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.496036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.496370 (+ 334us) server_negotiation.cc:407] Connection header received
0808 07:05:30.497387 (+ 1017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.497388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.497402 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.497433 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.498216 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.498970 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.500034 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.500339 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.500393 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.506725 (+ 6332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.506728 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.506729 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.506739 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.510050 (+ 3311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.510608 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.510610 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.510611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.510693 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.510962 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.510963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.510963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.511142 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.511227 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.511552 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.511659 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:05:30.511996 8236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.495859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:60357)
0808 07:05:30.496293 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.496303 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.497270 (+ 967us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.497522 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.497526 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.497897 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.498100 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.498106 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.499051 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.499052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.499901 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.499903 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.500443 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.500444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.500493 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.500983 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.500994 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.506547 (+ 5553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.510164 (+ 3617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.510178 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.510181 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.510510 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.510767 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.510768 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.510768 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.510898 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.511209 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.511213 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.511380 (+ 167us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.511477 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.511654 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"mutex_wait_us":13,"thread_start_us":91,"threads_started":1}
I20260808 07:05:30.512748 8230 heartbeater.cc:347] Connected to a master server at 127.29.82.126:43645
I20260808 07:05:30.512880 8230 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:30.513105 8230 heartbeater.cc:511] Master 127.29.82.126:43645 requested a full tablet report, sending...
I20260808 07:05:30.513584 6748 ts_manager.cc:194] Re-registered known tserver with Master: d19002f56a194dc7b126516d01a01cce (127.29.82.65:39795)
I20260808 07:05:30.514101 6748 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:60357
I20260808 07:05:30.516193 8235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.495846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:54437 (local address 127.29.82.124:33505)
0808 07:05:30.495989 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.495992 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.496254 (+ 262us) server_negotiation.cc:407] Connection header received
0808 07:05:30.497348 (+ 1094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.497350 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.497366 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.497435 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.498192 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.499163 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.499957 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.500261 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.500326 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.513273 (+ 12947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.513275 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.513275 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.513285 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.514886 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.515273 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.515275 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.515276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.515339 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.515667 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.515668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.515668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.515807 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.515870 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.516004 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.516092 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":62,"threads_started":1}
I20260808 07:05:30.516204 8237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.495858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:33505 (local address 127.29.82.65:54437)
0808 07:05:30.496132 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.496176 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.497247 (+ 1071us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.497522 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.497526 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.497864 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.498099 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.498104 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.499230 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.499232 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.499877 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.499878 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.500342 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.500343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.500487 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.501234 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.501239 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.513075 (+ 11836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.514981 (+ 1906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.514983 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.514983 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.515192 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.515403 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.515404 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.515404 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.515463 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.515873 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.515874 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.515917 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.515972 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.516090 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":14,"thread_start_us":106,"threads_started":1}
I20260808 07:05:30.516417 7729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.496254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:55369 (local address 127.29.82.125:33931)
0808 07:05:30.496302 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.496304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.496453 (+ 149us) server_negotiation.cc:407] Connection header received
0808 07:05:30.497388 (+ 935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.497389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.497402 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.497433 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.498205 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.498701 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.500002 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.500222 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.500255 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.513233 (+ 12978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.513235 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.513236 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.513246 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.515178 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.515538 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.515540 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.515540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.515594 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.515788 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.515790 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.515790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.515958 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.516041 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.516250 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.516335 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:05:30.516808 8228 heartbeater.cc:347] Connected to a master server at 127.29.82.124:33505
I20260808 07:05:30.516865 8228 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:30.516949 8228 heartbeater.cc:511] Master 127.29.82.124:33505 requested a full tablet report, sending...
I20260808 07:05:30.517032 8238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.496145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33931 (local address 127.29.82.65:55369)
0808 07:05:30.496399 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.496405 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.497271 (+ 866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.497558 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.497558 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.497878 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.498100 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.498106 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.498798 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.498799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.499901 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.499903 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.500340 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.500341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.500487 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.501311 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.501315 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.513079 (+ 11764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.515271 (+ 2192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.515272 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.515272 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.515463 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.515653 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.515654 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.515654 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.515716 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.516074 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.516075 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.516125 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.516788 (+ 663us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.516911 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":12,"thread_start_us":65,"threads_started":1}
I20260808 07:05:30.517379 8231 heartbeater.cc:347] Connected to a master server at 127.29.82.125:33931
I20260808 07:05:30.517387 7949 ts_manager.cc:194] Registered new tserver with Master: d19002f56a194dc7b126516d01a01cce (127.29.82.65:39795)
I20260808 07:05:30.517434 8231 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:30.517477 8231 heartbeater.cc:511] Master 127.29.82.125:33931 requested a full tablet report, sending...
I20260808 07:05:30.517812 7668 ts_manager.cc:194] Registered new tserver with Master: d19002f56a194dc7b126516d01a01cce (127.29.82.65:39795)
I20260808 07:05:30.519019 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:43875
--local_ip_for_outbound_sockets=127.29.82.66
--tserver_master_addrs=127.29.82.126:43645
--webserver_port=36435
--webserver_interface=127.29.82.66
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.66.keytab
--principal=oryx/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:45293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.29.82.126:43645,127.29.82.125:33931
--tserver_master_addrs=127.29.82.126:43645,127.29.82.125:33931,127.29.82.124:33505 with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:30.603351 8239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:30.603576 8239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:30.603601 8239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:30.604773 8239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:30.604815 8239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:30.604840 8239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:05:30.606411 8239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:45293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.66.keytab
--principal=oryx/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:43875
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=36435
--tserver_master_addrs=127.29.82.126:43645,127.29.82.125:33931,127.29.82.124:33505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:30.606662 8239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:30.606892 8239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:30.611845 8245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:30.611848 8246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:30.611835 8248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:30.612082 8239 server_base.cc:1034] running on GCE node
I20260808 07:05:30.612289 8239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:30.612522 8239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:30.613663 8239 hybrid_clock.cc:648] HybridClock initialized: now 1786172730613637 us; error 38 us; skew 500 ppm
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:30.616171 8239 init.cc:377] Logged in from keytab as oryx/127.29.82.66@KRBTEST.COM (short username oryx)
I20260808 07:05:30.616631 8239 webserver.cc:460] Webserver started at http://127.29.82.66:36435/ using document root <none> and password file <none>
I20260808 07:05:30.616855 8239 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:30.616917 8239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:30.618398 8239 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:30.619060 8258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.619225 8239 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:30.619333 8239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "b8d771caf9ba4a568daa78ffd425fd8e"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "95c26a4251e3dcbc095263aa217a4a84"
server_key_iv: "8eb1c181d2547e954656ba5c8484cb86"
server_key_version: "encryptionkey@0"
I20260808 07:05:30.619710 8239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:30.651217 8239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:30.653256 8239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:30.653402 8239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:30.653650 8239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:30.653967 8239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:30.654000 8239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.654029 8239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:30.654045 8239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.659825 8239 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:43875
I20260808 07:05:30.659883 8420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:43875 every 8 connection(s)
I20260808 07:05:30.660229 8239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:05:30.665113 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 8239
I20260808 07:05:30.665287 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 7249
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.124@KRBTEST.COM
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
I20260808 07:05:30.672979 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.660984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:42073 (local address 127.29.82.126:43645)
0808 07:05:30.661037 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.661039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.661354 (+ 315us) server_negotiation.cc:407] Connection header received
0808 07:05:30.662479 (+ 1125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.662481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.662497 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.662552 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.663448 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.664209 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.666421 (+ 2212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.666696 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.666732 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.670227 (+ 3495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.670229 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.670230 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.670239 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.671651 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.672077 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.672078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.672079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.672132 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.672345 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.672345 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.672346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.672465 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.672505 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.672816 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.672893 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:05:30.673530 8235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.660998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:46201 (local address 127.29.82.124:33505)
0808 07:05:30.661056 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.661058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.661366 (+ 308us) server_negotiation.cc:407] Connection header received
0808 07:05:30.662627 (+ 1261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.662629 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.662644 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.662696 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.664313 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.664807 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.665771 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.666104 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.666147 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.670170 (+ 4023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.670172 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.670172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.670180 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.672117 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.672554 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.672556 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.672556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.672621 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.672844 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.672845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.672845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.672990 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.673047 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.673309 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.673414 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:05:30.673674 8429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.661000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:42073)
0808 07:05:30.661218 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.661264 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.662376 (+ 1112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.662613 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.662616 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.663090 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.663321 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.663327 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.664312 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.664313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.665475 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.665478 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.666798 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.666798 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.666847 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.668437 (+ 1590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.668442 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.670108 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.671742 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.671749 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.671752 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.672003 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.672180 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.672180 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.672180 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.672288 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.672541 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.672547 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.672699 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.673203 (+ 504us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.673372 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":6,"thread_start_us":100,"threads_started":1}
I20260808 07:05:30.673898 8428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.661000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:33505 (local address 127.29.82.66:46201)
0808 07:05:30.661301 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.661310 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.662363 (+ 1053us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.662712 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.662713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.663090 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.663321 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.663327 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.664887 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.664888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.665679 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.665681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.666237 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.666237 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.666399 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.667779 (+ 1380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.667789 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.670062 (+ 2273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.672224 (+ 2162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.672225 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.672225 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.672443 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.672698 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.672699 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.672699 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.672764 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.673086 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.673087 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.673137 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.673663 (+ 526us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.673782 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":7,"thread_start_us":100,"threads_started":1}
I20260808 07:05:30.674919 8423 heartbeater.cc:347] Connected to a master server at 127.29.82.126:43645
I20260808 07:05:30.675021 8423 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:30.675203 8423 heartbeater.cc:511] Master 127.29.82.126:43645 requested a full tablet report, sending...
I20260808 07:05:30.675625 6748 ts_manager.cc:194] Re-registered known tserver with Master: b8d771caf9ba4a568daa78ffd425fd8e (127.29.82.66:43875)
I20260808 07:05:30.676229 6748 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:42073
I20260808 07:05:30.677567 8422 heartbeater.cc:347] Connected to a master server at 127.29.82.124:33505
I20260808 07:05:30.677629 8422 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:30.677713 8422 heartbeater.cc:511] Master 127.29.82.124:33505 requested a full tablet report, sending...
I20260808 07:05:30.677994 7949 ts_manager.cc:194] Registered new tserver with Master: b8d771caf9ba4a568daa78ffd425fd8e (127.29.82.66:43875)
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.125@KRBTEST.COM
I20260808 07:05:30.686336 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:39831
--local_ip_for_outbound_sockets=127.29.82.67
--tserver_master_addrs=127.29.82.126:43645
--webserver_port=35151
--webserver_interface=127.29.82.67
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.67.keytab
--principal=oryx/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:45293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.29.82.126:43645,127.29.82.125:33931
--tserver_master_addrs=127.29.82.126:43645,127.29.82.125:33931,127.29.82.124:33505 with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:05:30.687271 8430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.661335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33931 (local address 127.29.82.66:45245)
0808 07:05:30.661453 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.661462 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.662381 (+ 919us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.662646 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.662647 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.663089 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.663320 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.663326 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.665585 (+ 2259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.665586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.666320 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.666321 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.682648 (+ 16327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.682649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.682767 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.683205 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.683210 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.684700 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.686243 (+ 1543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.686243 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.686244 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.686416 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.686661 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.686661 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.686661 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.686710 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.686989 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.686990 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.687041 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.687086 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.687187 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":65,"threads_started":1}
I20260808 07:05:30.687287 7729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.661417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:45245 (local address 127.29.82.125:33931)
0808 07:05:30.661466 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.661467 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.661524 (+ 57us) server_negotiation.cc:407] Connection header received
0808 07:05:30.662491 (+ 967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.662492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.662544 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.662577 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.663412 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.664212 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.682311 (+ 18099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.682542 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.682616 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.684811 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.684814 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.684814 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.684822 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.686160 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.686518 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.686520 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.686520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.686588 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.686771 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.686772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.686773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.686926 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.686998 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.687123 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.687203 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:05:30.687978 8425 heartbeater.cc:347] Connected to a master server at 127.29.82.125:33931
I20260808 07:05:30.688035 8425 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:30.688092 8425 heartbeater.cc:511] Master 127.29.82.125:33931 requested a full tablet report, sending...
I20260808 07:05:30.688408 7668 ts_manager.cc:194] Registered new tserver with Master: b8d771caf9ba4a568daa78ffd425fd8e (127.29.82.66:43875)
W20260808 07:05:30.772018 8431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:30.772240 8431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:30.772272 8431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:30.773510 8431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:30.773554 8431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:30.773590 8431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:05:30.775085 8431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:45293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.67.keytab
--principal=oryx/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:39831
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=35151
--tserver_master_addrs=127.29.82.126:43645,127.29.82.125:33931,127.29.82.124:33505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:05:30.775321 8431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:30.775539 8431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:30.780659 8442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:30.780634 8439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:30.780829 8431 server_base.cc:1034] running on GCE node
W20260808 07:05:30.780642 8438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:30.781109 8431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:30.781363 8431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:30.782518 8431 hybrid_clock.cc:648] HybridClock initialized: now 1786172730782500 us; error 29 us; skew 500 ppm
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:30.785181 8431 init.cc:377] Logged in from keytab as oryx/127.29.82.67@KRBTEST.COM (short username oryx)
I20260808 07:05:30.785626 8431 webserver.cc:460] Webserver started at http://127.29.82.67:35151/ using document root <none> and password file <none>
I20260808 07:05:30.785823 8431 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:30.785885 8431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:30.787215 8431 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:30.787758 8450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.787909 8431 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:30.788003 8431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "e6cdcf6d8bd24de4aad96397913d3f6b"
format_stamp: "Formatted at 2026-08-08 07:05:29 on dist-test-slave-rmhg"
server_key: "314ceb82c56f2e44a351dc39c56f3d0a"
server_key_iv: "c8fa414843dbde1456c0560ca2ce71af"
server_key_version: "encryptionkey@0"
I20260808 07:05:30.788343 8431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:30.805320 8431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:30.807497 8431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:30.807619 8431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:30.807864 8431 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:30.808183 8431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:30.808219 8431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.808248 8431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:30.808295 8431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:30.814045 8431 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:39831
I20260808 07:05:30.814106 8639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:39831 every 8 connection(s)
I20260808 07:05:30.814451 8431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.124@KRBTEST.COM
I20260808 07:05:30.822388 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 8431
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
Aug 08 07:05:30 dist-test-slave-rmhg krb5kdc[6683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172730, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.125@KRBTEST.COM
I20260808 07:05:30.826254 8235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.815244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:35639 (local address 127.29.82.124:33505)
0808 07:05:30.815294 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.815297 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.815507 (+ 210us) server_negotiation.cc:407] Connection header received
0808 07:05:30.816653 (+ 1146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.816655 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.816668 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.816712 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.818153 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.818866 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.819797 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.820106 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.820170 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.822685 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.822686 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.822687 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.822694 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.824336 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.824948 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.824949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.824950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.825008 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.825336 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.825337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.825338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.825467 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.825533 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.826044 (+ 511us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.826149 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:05:30.827119 8647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.815205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:59215)
0808 07:05:30.815538 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.815549 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.816486 (+ 937us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.816745 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.816750 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.817202 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.817425 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.817430 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.818156 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.818157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.819395 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.819398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.819918 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.819919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.820055 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.820640 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.820651 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.824011 (+ 3360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.825889 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.825890 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.825890 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.826120 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.826329 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.826330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.826330 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.826388 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.826667 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.826668 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.826713 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.826771 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.826871 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":4,"thread_start_us":88,"threads_started":1}
I20260808 07:05:30.827523 8648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.815503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33931 (local address 127.29.82.67:43925)
0808 07:05:30.815653 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.815662 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.816463 (+ 801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.816747 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.816752 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.817209 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.817427 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.817433 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.819695 (+ 2262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.819695 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.820447 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.820449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.820902 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.820904 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.820981 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.821426 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.821432 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.823740 (+ 2308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.826374 (+ 2634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.826375 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.826376 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.826663 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.826885 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.826885 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.826886 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.826943 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.827216 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.827217 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.827262 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.827316 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.827410 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":24,"thread_start_us":79,"threads_started":1}
I20260808 07:05:30.827548 6815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.815211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:59215 (local address 127.29.82.126:43645)
0808 07:05:30.815294 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.815297 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.815607 (+ 310us) server_negotiation.cc:407] Connection header received
0808 07:05:30.816607 (+ 1000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.816609 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.816620 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.816651 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.817529 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.818054 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.819548 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.819843 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.819904 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.824124 (+ 4220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.824126 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.824127 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.824136 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.825810 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.826198 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.826200 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.826200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.826263 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.826451 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.826452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.826452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.826581 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.826640 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.827378 (+ 738us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.827460 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 07:05:30.827126 8645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.815205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:33505 (local address 127.29.82.67:35639)
0808 07:05:30.815376 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.815413 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.816455 (+ 1042us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.816758 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.816759 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.817206 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:30.817427 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.817433 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.818969 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.818970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.819704 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.819707 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.820182 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.820183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.820241 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.820757 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:30.820762 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:30.822592 (+ 1830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:30.824511 (+ 1919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.824519 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.824523 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.824838 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.825081 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:30.825082 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:30.825083 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:30.825265 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:30.825524 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:30.825531 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:30.825747 (+ 216us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.826617 (+ 870us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.826816 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":2,"thread_start_us":88,"threads_started":1}
I20260808 07:05:30.828318 8640 heartbeater.cc:347] Connected to a master server at 127.29.82.124:33505
I20260808 07:05:30.828444 8640 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:30.828656 8640 heartbeater.cc:511] Master 127.29.82.124:33505 requested a full tablet report, sending...
I20260808 07:05:30.828893 8641 heartbeater.cc:347] Connected to a master server at 127.29.82.126:43645
I20260808 07:05:30.828996 8641 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:30.829097 8641 heartbeater.cc:511] Master 127.29.82.126:43645 requested a full tablet report, sending...
I20260808 07:05:30.829107 7949 ts_manager.cc:194] Registered new tserver with Master: e6cdcf6d8bd24de4aad96397913d3f6b (127.29.82.67:39831)
I20260808 07:05:30.829427 6748 ts_manager.cc:194] Re-registered known tserver with Master: e6cdcf6d8bd24de4aad96397913d3f6b (127.29.82.67:39831)
I20260808 07:05:30.829635 7729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.815689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:43925 (local address 127.29.82.125:33931)
0808 07:05:30.815732 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.815734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.815742 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:30.816583 (+ 841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.816585 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.816600 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.816657 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.818993 (+ 2336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.819628 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.820555 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.820819 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.820892 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.823848 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.823850 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.823850 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.823859 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.826274 (+ 2415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.826754 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.826756 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.826756 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.826819 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.827006 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.827007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.827008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.827130 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.827189 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.827714 (+ 525us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.829544 (+ 1830us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:05:30.829881 8642 heartbeater.cc:347] Connected to a master server at 127.29.82.125:33931
I20260808 07:05:30.829885 6748 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:59215
I20260808 07:05:30.829921 8642 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:30.829977 8642 heartbeater.cc:511] Master 127.29.82.125:33931 requested a full tablet report, sending...
I20260808 07:05:30.830327 7668 ts_manager.cc:194] Registered new tserver with Master: e6cdcf6d8bd24de4aad96397913d3f6b (127.29.82.67:39831)
I20260808 07:05:30.833046 8662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.824219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33464 (local address 127.29.82.125:33931)
0808 07:05:30.824354 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.824356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.825769 (+ 1413us) server_negotiation.cc:407] Connection header received
0808 07:05:30.825867 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.825868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.825882 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.825922 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.826730 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.827437 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.828478 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.828787 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.828826 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.830316 (+ 1490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.830318 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.830318 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.830325 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.831920 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.832250 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.832252 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.832252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.832313 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.832508 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.832509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.832509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.832626 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.832716 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.832832 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.832931 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":65,"threads_started":1}
I20260808 07:05:30.835255 8654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.823696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35934 (local address 127.29.82.124:33505)
0808 07:05:30.824404 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.824405 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.827788 (+ 3383us) server_negotiation.cc:407] Connection header received
0808 07:05:30.827812 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.827813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.827826 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.827888 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.828470 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.829176 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.830150 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.830459 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.830518 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.831817 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.831819 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.831819 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.831826 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.833881 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.834238 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.834239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.834240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.834296 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.834700 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.834701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.834701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.834812 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.834900 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.835016 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.835095 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":60,"threads_started":1}
I20260808 07:05:30.836613 8653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.823527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53866 (local address 127.29.82.126:43645)
0808 07:05:30.824485 (+ 958us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.824487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.827144 (+ 2657us) server_negotiation.cc:407] Connection header received
0808 07:05:30.827405 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.827407 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.827425 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.830838 (+ 3413us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.830883 (+ 45us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.831549 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.832430 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.832723 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.833032 (+ 309us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.834230 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.834232 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.834232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.834239 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.835599 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.835921 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.835922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.835922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.835977 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.836147 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.836148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.836149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.836253 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.836334 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.836441 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.836519 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":920,"thread_start_us":93,"threads_started":1}
I20260808 07:05:30.838164 6748 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:30.839716 6748 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:30.847329 8669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.843391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:43875 (local address 127.0.0.1:58700)
0808 07:05:30.843541 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.843550 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.843591 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.844223 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.844223 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.844225 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:30.844255 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.844256 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.845131 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.845132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.846231 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.846233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.847090 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.847091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.847151 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.847156 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.847202 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.847243 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":101,"threads_started":1}
I20260808 07:05:30.847424 7609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.843345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:39795 (local address 127.0.0.1:56518)
0808 07:05:30.843391 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.843400 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.843436 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.843893 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.843894 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.843896 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:30.843947 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.843949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.845578 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.845579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.846416 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.846418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.847208 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.847209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.847258 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.847261 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.847298 (+ 37us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.847333 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 07:05:30.847452 8670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.843459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56518 (local address 127.29.82.65:39795)
0808 07:05:30.843695 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.843699 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.843708 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:05:30.843762 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.843764 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.843781 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.844072 (+ 291us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:30.844139 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.845519 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.846500 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.847138 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.847211 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.847300 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.847328 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.847365 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":124,"threads_started":1}
I20260808 07:05:30.847743 8671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.843502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58700 (local address 127.29.82.66:43875)
0808 07:05:30.844050 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.844055 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.844065 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:05:30.844106 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.844109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.844124 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.844318 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:30.844363 (+ 45us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.845049 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.846328 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.847006 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.847068 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.847151 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.847530 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.847588 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":100,"threads_started":1}
I20260808 07:05:30.847879 8672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.843596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:39831 (local address 127.0.0.1:59922)
0808 07:05:30.843723 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.843734 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.843784 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.844157 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.844158 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.844159 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:30.844201 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.844203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.845549 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.845550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.846629 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.846631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.847622 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.847623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.847677 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.847681 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.847729 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.847772 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"mutex_wait_us":34,"thread_start_us":74,"threads_started":1}
I20260808 07:05:30.847890 8675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.843809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59922 (local address 127.29.82.67:39831)
0808 07:05:30.843982 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.843996 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.844006 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:05:30.844054 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.844056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.844072 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.844147 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:30.844262 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.845463 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.846711 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.847431 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.847497 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.847587 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.847763 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.847805 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":90,"threads_started":1}
I20260808 07:05:30.848593 8330 tablet_service.cc:1467] Processing CreateTablet for tablet a506cbc027274c66885354c9a9f4a0d8 (DEFAULT_TABLE table=test-table [id=38169fc5fd234b91bc7850ddc3fdc966]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:30.848706 8122 tablet_service.cc:1467] Processing CreateTablet for tablet a506cbc027274c66885354c9a9f4a0d8 (DEFAULT_TABLE table=test-table [id=38169fc5fd234b91bc7850ddc3fdc966]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:30.848964 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a506cbc027274c66885354c9a9f4a0d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:30.849025 8122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a506cbc027274c66885354c9a9f4a0d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:30.852150 8677 tablet_bootstrap.cc:492] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e: Bootstrap starting.
I20260808 07:05:30.852537 8529 tablet_service.cc:1467] Processing CreateTablet for tablet a506cbc027274c66885354c9a9f4a0d8 (DEFAULT_TABLE table=test-table [id=38169fc5fd234b91bc7850ddc3fdc966]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:30.852803 8677 tablet_bootstrap.cc:654] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:30.852855 8529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a506cbc027274c66885354c9a9f4a0d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:30.853096 8677 log.cc:824] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:30.853358 8676 tablet_bootstrap.cc:492] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce: Bootstrap starting.
I20260808 07:05:30.854025 8677 tablet_bootstrap.cc:492] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e: No bootstrap required, opened a new log
I20260808 07:05:30.854110 8676 tablet_bootstrap.cc:654] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:30.854106 8677 ts_tablet_manager.cc:1397] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:30.854475 8676 log.cc:824] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:30.856022 8684 tablet_bootstrap.cc:492] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b: Bootstrap starting.
I20260808 07:05:30.856238 8677 raft_consensus.cc:348] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d19002f56a194dc7b126516d01a01cce" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39795 } } peers { permanent_uuid: "b8d771caf9ba4a568daa78ffd425fd8e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 43875 } } peers { permanent_uuid: "e6cdcf6d8bd24de4aad96397913d3f6b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 39831 } }
I20260808 07:05:30.856418 8677 raft_consensus.cc:374] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:30.856457 8677 raft_consensus.cc:729] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d771caf9ba4a568daa78ffd425fd8e, State: Initialized, Role: FOLLOWER
I20260808 07:05:30.856586 8677 consensus_queue.cc:260] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d19002f56a194dc7b126516d01a01cce" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39795 } } peers { permanent_uuid: "b8d771caf9ba4a568daa78ffd425fd8e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 43875 } } peers { permanent_uuid: "e6cdcf6d8bd24de4aad96397913d3f6b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 39831 } }
I20260808 07:05:30.856655 8676 tablet_bootstrap.cc:492] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce: No bootstrap required, opened a new log
I20260808 07:05:30.856717 8676 ts_tablet_manager.cc:1397] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:05:30.856801 8684 tablet_bootstrap.cc:654] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:30.856879 8677 ts_tablet_manager.cc:1428] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:05:30.857012 8423 heartbeater.cc:503] Master 127.29.82.126:43645 was elected leader, sending a full tablet report...
I20260808 07:05:30.857249 8684 log.cc:824] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:30.858055 8684 tablet_bootstrap.cc:492] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b: No bootstrap required, opened a new log
I20260808 07:05:30.858127 8684 ts_tablet_manager.cc:1397] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:05:30.858920 8676 raft_consensus.cc:348] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d19002f56a194dc7b126516d01a01cce" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39795 } } peers { permanent_uuid: "b8d771caf9ba4a568daa78ffd425fd8e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 43875 } } peers { permanent_uuid: "e6cdcf6d8bd24de4aad96397913d3f6b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 39831 } }
I20260808 07:05:30.859077 8676 raft_consensus.cc:374] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:30.859113 8676 raft_consensus.cc:729] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19002f56a194dc7b126516d01a01cce, State: Initialized, Role: FOLLOWER
I20260808 07:05:30.859233 8676 consensus_queue.cc:260] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d19002f56a194dc7b126516d01a01cce" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39795 } } peers { permanent_uuid: "b8d771caf9ba4a568daa78ffd425fd8e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 43875 } } peers { permanent_uuid: "e6cdcf6d8bd24de4aad96397913d3f6b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 39831 } }
I20260808 07:05:30.859508 8230 heartbeater.cc:503] Master 127.29.82.126:43645 was elected leader, sending a full tablet report...
I20260808 07:05:30.859706 8676 ts_tablet_manager.cc:1428] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:05:30.860532 8684 raft_consensus.cc:348] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d19002f56a194dc7b126516d01a01cce" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39795 } } peers { permanent_uuid: "b8d771caf9ba4a568daa78ffd425fd8e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 43875 } } peers { permanent_uuid: "e6cdcf6d8bd24de4aad96397913d3f6b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 39831 } }
I20260808 07:05:30.860702 8684 raft_consensus.cc:374] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:30.860749 8684 raft_consensus.cc:729] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6cdcf6d8bd24de4aad96397913d3f6b, State: Initialized, Role: FOLLOWER
I20260808 07:05:30.860884 8684 consensus_queue.cc:260] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d19002f56a194dc7b126516d01a01cce" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39795 } } peers { permanent_uuid: "b8d771caf9ba4a568daa78ffd425fd8e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 43875 } } peers { permanent_uuid: "e6cdcf6d8bd24de4aad96397913d3f6b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 39831 } }
I20260808 07:05:30.861218 8641 heartbeater.cc:503] Master 127.29.82.126:43645 was elected leader, sending a full tablet report...
I20260808 07:05:30.861133 8684 ts_tablet_manager.cc:1428] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 07:05:30.890834 8688 raft_consensus.cc:482] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:30.890976 8688 raft_consensus.cc:504] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d19002f56a194dc7b126516d01a01cce" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39795 } } peers { permanent_uuid: "b8d771caf9ba4a568daa78ffd425fd8e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 43875 } } peers { permanent_uuid: "e6cdcf6d8bd24de4aad96397913d3f6b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 39831 } }
I20260808 07:05:30.891316 8688 leader_election.cc:288] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d771caf9ba4a568daa78ffd425fd8e (127.29.82.66:43875), e6cdcf6d8bd24de4aad96397913d3f6b (127.29.82.67:39831)
I20260808 07:05:30.894356 8237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.891570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:39831 (local address 127.29.82.65:37831)
0808 07:05:30.891629 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.891638 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.891677 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.891924 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.891925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.891927 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:30.891995 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.891997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.892638 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.892640 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.893504 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.893507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.894100 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.894101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.894182 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.894185 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.894234 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.894271 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":48}
I20260808 07:05:30.894342 8671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.891556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:57893 (local address 127.29.82.66:43875)
0808 07:05:30.891609 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.891611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.891671 (+ 60us) server_negotiation.cc:407] Connection header received
0808 07:05:30.891698 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.891699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.891710 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.891757 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:30.891923 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.892535 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.893608 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.894014 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.894075 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.894085 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.894228 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.894269 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:05:30.894356 8675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.891760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:37831 (local address 127.29.82.67:39831)
0808 07:05:30.891810 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.891812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.891819 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:05:30.891845 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.891846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.891855 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.891908 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:30.892054 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.892561 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.893583 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.894019 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.894085 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.894094 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.894247 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.894288 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:05:30.894378 8238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.891472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:43875 (local address 127.29.82.65:57893)
0808 07:05:30.891527 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.891539 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:30.891596 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:30.891770 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:30.891772 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:30.891773 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:30.891861 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.891862 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.892606 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.892608 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.893522 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:30.893525 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.894090 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.894091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:30.894167 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.894171 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:30.894210 (+ 39us) client_negotiation.cc:240] Negotiation successful
0808 07:05:30.894253 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":41}
I20260808 07:05:30.894737 8357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a506cbc027274c66885354c9a9f4a0d8" candidate_uuid: "d19002f56a194dc7b126516d01a01cce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d771caf9ba4a568daa78ffd425fd8e" is_pre_election: true
I20260808 07:05:30.894801 8565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a506cbc027274c66885354c9a9f4a0d8" candidate_uuid: "d19002f56a194dc7b126516d01a01cce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6cdcf6d8bd24de4aad96397913d3f6b" is_pre_election: true
I20260808 07:05:30.894882 8357 raft_consensus.cc:2454] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d19002f56a194dc7b126516d01a01cce in term 0.
I20260808 07:05:30.894948 8565 raft_consensus.cc:2454] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d19002f56a194dc7b126516d01a01cce in term 0.
I20260808 07:05:30.895162 8053 leader_election.cc:302] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d771caf9ba4a568daa78ffd425fd8e, d19002f56a194dc7b126516d01a01cce; no voters:
I20260808 07:05:30.895311 8688 raft_consensus.cc:2781] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:30.895381 8688 raft_consensus.cc:482] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:30.895398 8688 raft_consensus.cc:3037] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:30.896215 8688 raft_consensus.cc:504] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d19002f56a194dc7b126516d01a01cce" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39795 } } peers { permanent_uuid: "b8d771caf9ba4a568daa78ffd425fd8e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 43875 } } peers { permanent_uuid: "e6cdcf6d8bd24de4aad96397913d3f6b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 39831 } }
I20260808 07:05:30.896337 8688 leader_election.cc:288] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [CANDIDATE]: Term 1 election: Requested vote from peers b8d771caf9ba4a568daa78ffd425fd8e (127.29.82.66:43875), e6cdcf6d8bd24de4aad96397913d3f6b (127.29.82.67:39831)
I20260808 07:05:30.896497 8357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a506cbc027274c66885354c9a9f4a0d8" candidate_uuid: "d19002f56a194dc7b126516d01a01cce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d771caf9ba4a568daa78ffd425fd8e"
I20260808 07:05:30.896530 8565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a506cbc027274c66885354c9a9f4a0d8" candidate_uuid: "d19002f56a194dc7b126516d01a01cce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6cdcf6d8bd24de4aad96397913d3f6b"
I20260808 07:05:30.896595 8565 raft_consensus.cc:3037] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:30.896595 8357 raft_consensus.cc:3037] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:30.897408 8565 raft_consensus.cc:2454] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19002f56a194dc7b126516d01a01cce in term 1.
I20260808 07:05:30.897492 8357 raft_consensus.cc:2454] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d19002f56a194dc7b126516d01a01cce in term 1.
I20260808 07:05:30.897594 8053 leader_election.cc:302] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d19002f56a194dc7b126516d01a01cce, e6cdcf6d8bd24de4aad96397913d3f6b; no voters:
I20260808 07:05:30.897713 8688 raft_consensus.cc:2781] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:30.897878 8688 raft_consensus.cc:686] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [term 1 LEADER]: Becoming Leader. State: Replica: d19002f56a194dc7b126516d01a01cce, State: Running, Role: LEADER
I20260808 07:05:30.897997 8688 consensus_queue.cc:237] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d19002f56a194dc7b126516d01a01cce" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39795 } } peers { permanent_uuid: "b8d771caf9ba4a568daa78ffd425fd8e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 43875 } } peers { permanent_uuid: "e6cdcf6d8bd24de4aad96397913d3f6b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 39831 } }
I20260808 07:05:30.899137 6748 catalog_manager.cc:5495] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce reported cstate change: term changed from 0 to 1, leader changed from <none> to d19002f56a194dc7b126516d01a01cce (127.29.82.65). New cstate: current_term: 1 leader_uuid: "d19002f56a194dc7b126516d01a01cce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d19002f56a194dc7b126516d01a01cce" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d771caf9ba4a568daa78ffd425fd8e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6cdcf6d8bd24de4aad96397913d3f6b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 39831 } health_report { overall_health: UNKNOWN } } }
I20260808 07:05:30.904794 8670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.902703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56530 (local address 127.29.82.65:39795)
0808 07:05:30.902748 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.902750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.902758 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:30.902789 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.902790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.902806 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.902864 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:30.902976 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.903442 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.904151 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.904324 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.904367 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.904473 (+ 106us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:30.904574 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:30.904634 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.904722 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.904739 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:05:30.906682 8357 raft_consensus.cc:1261] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e [term 1 FOLLOWER]: Refusing update from remote peer d19002f56a194dc7b126516d01a01cce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:30.906682 8565 raft_consensus.cc:1261] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b [term 1 FOLLOWER]: Refusing update from remote peer d19002f56a194dc7b126516d01a01cce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:30.907037 8690 consensus_queue.cc:1035] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d771caf9ba4a568daa78ffd425fd8e" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:30.907168 8688 consensus_queue.cc:1035] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6cdcf6d8bd24de4aad96397913d3f6b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:30.910111 8696 mvcc.cc:205] Tried to move back new op lower bound from 7316163505790992384 to 7316163505758879744. Current Snapshot: MvccSnapshot[applied={T|T < 7316163505790992384}]
I20260808 07:05:30.912305 6751 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:30.912340 8695 mvcc.cc:205] Tried to move back new op lower bound from 7316163505790992384 to 7316163505758879744. Current Snapshot: MvccSnapshot[applied={T|T < 7316163505790992384 or (T in {7316163505790992384})}]
I20260808 07:05:30.912402 6751 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:30.913717 6751 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8caf019b6be6444081601acfda7fb6fc: Sending DeleteTablet for 3 replicas of tablet a506cbc027274c66885354c9a9f4a0d8
I20260808 07:05:30.914043 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet a506cbc027274c66885354c9a9f4a0d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:30 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:58700
I20260808 07:05:30.914057 8529 tablet_service.cc:1514] Processing DeleteTablet for tablet a506cbc027274c66885354c9a9f4a0d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:30 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:59922
I20260808 07:05:30.914098 8122 tablet_service.cc:1514] Processing DeleteTablet for tablet a506cbc027274c66885354c9a9f4a0d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:30 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:56518
I20260808 07:05:30.914323 8713 tablet_replica.cc:330] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce: stopping tablet replica
I20260808 07:05:30.914418 8713 raft_consensus.cc:2229] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:05:30.914523 8713 raft_consensus.cc:2258] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:30.914690 8711 tablet_replica.cc:330] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b: stopping tablet replica
I20260808 07:05:30.914786 8711 raft_consensus.cc:2229] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:30.914883 8711 raft_consensus.cc:2258] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:30.915148 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 6700
I20260808 07:05:30.915377 8713 ts_tablet_manager.cc:1905] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:30.919414 8711 ts_tablet_manager.cc:1905] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:30.920833 8713 ts_tablet_manager.cc:1918] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:30.920946 8713 log.cc:1196] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-0/wal/wals/a506cbc027274c66885354c9a9f4a0d8
I20260808 07:05:30.921066 8711 ts_tablet_manager.cc:1918] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:30.921229 8711 log.cc:1196] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/a506cbc027274c66885354c9a9f4a0d8
I20260808 07:05:30.921352 8713 ts_tablet_manager.cc:1939] T a506cbc027274c66885354c9a9f4a0d8 P d19002f56a194dc7b126516d01a01cce: Deleting consensus metadata
I20260808 07:05:30.921593 8711 ts_tablet_manager.cc:1939] T a506cbc027274c66885354c9a9f4a0d8 P e6cdcf6d8bd24de4aad96397913d3f6b: Deleting consensus metadata
I20260808 07:05:30.921589 8709 tablet_replica.cc:330] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e: stopping tablet replica
I20260808 07:05:30.921806 8709 raft_consensus.cc:2229] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:30.921977 8709 raft_consensus.cc:2258] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:30.924445 8709 ts_tablet_manager.cc:1905] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:30.926227 8709 ts_tablet_manager.cc:1918] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:30.926307 8709 log.cc:1196] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/a506cbc027274c66885354c9a9f4a0d8
I20260808 07:05:30.926551 8709 ts_tablet_manager.cc:1939] T a506cbc027274c66885354c9a9f4a0d8 P b8d771caf9ba4a568daa78ffd425fd8e: Deleting consensus metadata
W20260808 07:05:30.934603 8259 connection.cc:535] server connection from 127.0.0.1:58700 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 07:05:30.934603 8454 connection.cc:535] server connection from 127.0.0.1:59922 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 07:05:30.934885 8060 connection.cc:535] server connection from 127.0.0.1:56518 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:05:30.941444 8654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.914543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35936 (local address 127.29.82.124:33505)
0808 07:05:30.914586 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.914588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.932881 (+ 18293us) server_negotiation.cc:407] Connection header received
0808 07:05:30.932928 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.932929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.932949 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.933023 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.933779 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.934586 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.935713 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.936022 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.936092 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.937763 (+ 1671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.937765 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.937765 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.937774 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.940015 (+ 2241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.940414 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.940415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.940416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.940473 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.940646 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.940646 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.940647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.940769 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.940854 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.941258 (+ 404us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.941345 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:05:30.945327 8235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.936827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35940 (local address 127.29.82.124:33505)
0808 07:05:30.936873 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.936875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.937235 (+ 360us) server_negotiation.cc:407] Connection header received
0808 07:05:30.937340 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.937341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.937352 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.937382 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.938306 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.939056 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.940830 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.941105 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.941145 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.943105 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.943106 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.943107 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.943113 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.944231 (+ 1118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.944558 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.944559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.944560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.944613 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.944777 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.944778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.944778 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.944883 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.944968 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.945070 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.945230 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:05:30.945952 8662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.936903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33468 (local address 127.29.82.125:33931)
0808 07:05:30.936949 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:30.936951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:30.937243 (+ 292us) server_negotiation.cc:407] Connection header received
0808 07:05:30.937341 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:30.937342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:30.937358 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:30.937386 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:30.938263 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.938809 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.940509 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:30.940838 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:30.940880 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:30.942434 (+ 1554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:30.942436 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:30.942436 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:30.942445 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:30.944481 (+ 2036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.944861 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.944862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.944862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.944919 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:30.945120 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:30.945121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:30.945121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:30.945408 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:30.945481 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:30.945682 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 07:05:30.945849 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:05:31.911443 8731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:31.911169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:52395)
0808 07:05:31.911302 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:31.911396 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
W20260808 07:05:31.911722 8641 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:43645 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
I20260808 07:05:31.912068 8733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:31.911844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:57719)
0808 07:05:31.911946 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:31.912023 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81,"thread_start_us":54,"threads_started":1}
W20260808 07:05:31.912288 8423 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:43645 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
I20260808 07:05:31.912539 8734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:31.912255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:40789)
0808 07:05:31.912419 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:31.912494 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":46,"threads_started":1}
W20260808 07:05:31.912698 8230 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:43645 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
I20260808 07:05:32.414927 8735 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8caf019b6be6444081601acfda7fb6fc)
I20260808 07:05:32.415056 8735 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } }
I20260808 07:05:32.415289 8735 leader_election.cc:288] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8caf019b6be6444081601acfda7fb6fc (127.29.82.126:43645)
I20260808 07:05:32.415650 8736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:32.415452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:54336)
0808 07:05:32.415560 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:32.415614 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":50,"threads_started":1}
W20260808 07:05:32.415781 7646 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
I20260808 07:05:32.416160 8736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:32.416067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:54342)
0808 07:05:32.416113 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:32.416141 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 07:05:32.416249 7646 leader_election.cc:334] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8caf019b6be6444081601acfda7fb6fc (127.29.82.126:43645): Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
I20260808 07:05:32.416296 7646 leader_election.cc:302] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a2cc406b6ed44508ad53d97451bb5171; no voters: 8caf019b6be6444081601acfda7fb6fc
I20260808 07:05:32.416379 8735 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:05:32.912308 8738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:32.912071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:47587)
0808 07:05:32.912202 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:32.912250 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":79,"threads_started":1}
I20260808 07:05:32.912870 8740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:32.912630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:47395)
0808 07:05:32.912772 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:32.912829 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":75,"threads_started":1}
I20260808 07:05:32.913192 8741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:32.912969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:50783)
0808 07:05:32.913089 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:32.913128 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":64,"threads_started":1}
I20260808 07:05:33.913233 8742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:33.912936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:36951)
0808 07:05:33.913103 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:33.913145 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":85,"threads_started":1}
I20260808 07:05:33.913616 8743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:33.913372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:43103)
0808 07:05:33.913539 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:33.913574 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":52,"threads_started":1}
I20260808 07:05:33.913810 8747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:33.913561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:40851)
0808 07:05:33.913730 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:33.913767 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":50,"threads_started":1}
I20260808 07:05:34.270627 8750 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8caf019b6be6444081601acfda7fb6fc)
I20260808 07:05:34.270735 8750 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } }
I20260808 07:05:34.270866 8750 leader_election.cc:288] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8caf019b6be6444081601acfda7fb6fc (127.29.82.126:43645)
I20260808 07:05:34.271245 8751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:34.271037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:54626)
0808 07:05:34.271164 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:34.271203 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":72,"threads_started":1}
I20260808 07:05:34.271642 8751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:34.271551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:54640)
0808 07:05:34.271596 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:34.271623 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 07:05:34.271713 7646 leader_election.cc:334] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8caf019b6be6444081601acfda7fb6fc (127.29.82.126:43645): Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
I20260808 07:05:34.271760 7646 leader_election.cc:302] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a2cc406b6ed44508ad53d97451bb5171; no voters: 8caf019b6be6444081601acfda7fb6fc
I20260808 07:05:34.271821 8750 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:05:34.914290 8753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:34.913882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:43307)
0808 07:05:34.914180 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:34.914231 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":63,"threads_started":1}
I20260808 07:05:34.914358 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:34.914042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:49259)
0808 07:05:34.914269 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:34.914309 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":44,"threads_started":1}
I20260808 07:05:34.914641 8759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:34.914162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:33585)
0808 07:05:34.914553 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:34.914590 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":44,"threads_started":1}
I20260808 07:05:35.915112 8760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:35.914781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:46077)
0808 07:05:35.915011 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:35.915056 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":70,"threads_started":1}
I20260808 07:05:35.915462 8761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:35.914821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:41239)
0808 07:05:35.915379 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:35.915418 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":60,"threads_started":1}
I20260808 07:05:35.915520 8762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:35.915263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:49263)
0808 07:05:35.915435 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:35.915476 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":47,"threads_started":1}
I20260808 07:05:36.357728 8763 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8caf019b6be6444081601acfda7fb6fc)
I20260808 07:05:36.357839 8763 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } }
I20260808 07:05:36.358000 8763 leader_election.cc:288] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8caf019b6be6444081601acfda7fb6fc (127.29.82.126:43645)
I20260808 07:05:36.358378 8764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.358170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:54834)
0808 07:05:36.358290 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:36.358339 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
I20260808 07:05:36.358829 8764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.358731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:54842)
0808 07:05:36.358777 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:36.358809 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 07:05:36.358903 7646 leader_election.cc:334] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8caf019b6be6444081601acfda7fb6fc (127.29.82.126:43645): Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
I20260808 07:05:36.358956 7646 leader_election.cc:302] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a2cc406b6ed44508ad53d97451bb5171; no voters: 8caf019b6be6444081601acfda7fb6fc
I20260808 07:05:36.359033 8763 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:05:36.916100 8767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.915663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:60391)
0808 07:05:36.915876 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:36.916042 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":70,"threads_started":1}
I20260808 07:05:36.916332 8768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.916010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:51409)
0808 07:05:36.916246 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:36.916286 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":69,"threads_started":1}
I20260808 07:05:36.916468 8769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.916230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:38525)
0808 07:05:36.916395 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:36.916426 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":54,"threads_started":1}
I20260808 07:05:37.917119 8774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.916877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:38907)
0808 07:05:37.917013 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:37.917058 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":73,"threads_started":1}
I20260808 07:05:37.917274 8773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.916865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:41891)
0808 07:05:37.917187 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:37.917225 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":62,"threads_started":1}
I20260808 07:05:37.917304 8772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.916856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:36277)
0808 07:05:37.917231 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:37.917266 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":67,"threads_started":1}
I20260808 07:05:38.918066 8775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:38.917634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:44483)
0808 07:05:38.917921 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:38.918005 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":82,"threads_started":1}
I20260808 07:05:38.918251 8776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:38.917694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:52611)
0808 07:05:38.918167 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:38.918204 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":58,"threads_started":1}
I20260808 07:05:38.918370 8777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:38.918124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:37261)
0808 07:05:38.918286 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:38.918327 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":51,"threads_started":1}
I20260808 07:05:39.716167 8778 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8caf019b6be6444081601acfda7fb6fc)
I20260808 07:05:39.716277 8778 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } }
I20260808 07:05:39.716408 8778 leader_election.cc:288] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8caf019b6be6444081601acfda7fb6fc (127.29.82.126:43645)
I20260808 07:05:39.716773 8780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.716587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:37838)
0808 07:05:39.716694 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:39.716734 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":52,"threads_started":1}
W20260808 07:05:39.716858 7646 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111) [suppressed 2 similar messages]
I20260808 07:05:39.717274 8780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.717133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:37844)
0808 07:05:39.717220 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:39.717252 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260808 07:05:39.717378 7646 leader_election.cc:334] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8caf019b6be6444081601acfda7fb6fc (127.29.82.126:43645): Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
I20260808 07:05:39.717438 7646 leader_election.cc:302] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a2cc406b6ed44508ad53d97451bb5171; no voters: 8caf019b6be6444081601acfda7fb6fc
I20260808 07:05:39.717521 8778 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:05:39.918896 8785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.918641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:52379)
0808 07:05:39.918796 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:39.918840 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":64,"threads_started":1}
I20260808 07:05:39.919095 8787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.918813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:45887)
0808 07:05:39.919007 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:39.919046 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":52,"threads_started":1}
I20260808 07:05:39.919140 8786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.918700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:38977)
0808 07:05:39.919071 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:39.919103 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":80,"threads_started":1}
I20260808 07:05:40.919940 8790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.919623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:37295)
0808 07:05:40.919839 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:40.919881 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":60,"threads_started":1}
I20260808 07:05:40.919940 8788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.919602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:51815)
0808 07:05:40.919839 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:40.919881 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":69,"threads_started":1}
I20260808 07:05:40.920028 8791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.919688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:55901)
0808 07:05:40.919955 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:40.919990 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":57,"threads_started":1}
I20260808 07:05:41.920791 8793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:41.920519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:57381)
0808 07:05:41.920687 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:41.920734 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":72,"threads_started":1}
I20260808 07:05:41.920910 8795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:41.920525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:46765)
0808 07:05:41.920822 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:41.920862 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":73,"threads_started":1}
I20260808 07:05:41.920974 8796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:41.920764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:57471)
0808 07:05:41.920906 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:41.920936 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":49,"threads_started":1}
I20260808 07:05:42.092636 8797 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8caf019b6be6444081601acfda7fb6fc)
I20260808 07:05:42.092752 8797 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } }
I20260808 07:05:42.092923 8797 leader_election.cc:288] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8caf019b6be6444081601acfda7fb6fc (127.29.82.126:43645)
I20260808 07:05:42.093325 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.093078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:37994)
0808 07:05:42.093239 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:42.093287 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":54,"threads_started":1}
I20260808 07:05:42.093727 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.093620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:38006)
0808 07:05:42.093673 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:42.093703 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 07:05:42.093802 7646 leader_election.cc:334] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8caf019b6be6444081601acfda7fb6fc (127.29.82.126:43645): Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
I20260808 07:05:42.093856 7646 leader_election.cc:302] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a2cc406b6ed44508ad53d97451bb5171; no voters: 8caf019b6be6444081601acfda7fb6fc
I20260808 07:05:42.093935 8797 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:05:42.921729 8800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.921393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:39437)
0808 07:05:42.921615 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:42.921669 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":84,"threads_started":1}
I20260808 07:05:42.921728 8802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.921493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:43965)
0808 07:05:42.921637 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:42.921674 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":44,"threads_started":1}
I20260808 07:05:42.921948 8803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.921732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:46185)
0808 07:05:42.921878 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:42.921912 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":47,"threads_started":1}
I20260808 07:05:43.922587 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.922215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:48753)
0808 07:05:43.922482 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:43.922530 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":78,"threads_started":1}
I20260808 07:05:43.922618 8805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.922278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:53155)
0808 07:05:43.922510 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:43.922582 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":80,"threads_started":1}
I20260808 07:05:43.922834 8807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.922476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:39701)
0808 07:05:43.922675 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:43.922789 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":69,"threads_started":1}
I20260808 07:05:44.923475 8808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:44.923148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:60257)
0808 07:05:44.923373 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:44.923418 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":76,"threads_started":1}
I20260808 07:05:44.923472 8809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:44.923200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:37729)
0808 07:05:44.923373 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:44.923417 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":63,"threads_started":1}
I20260808 07:05:44.923661 8813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:44.923198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:60783)
0808 07:05:44.923585 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:44.923623 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":71,"threads_started":1}
I20260808 07:05:45.103708 8814 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8caf019b6be6444081601acfda7fb6fc)
I20260808 07:05:45.103814 8814 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } }
I20260808 07:05:45.103968 8814 leader_election.cc:288] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8caf019b6be6444081601acfda7fb6fc (127.29.82.126:43645)
I20260808 07:05:45.104336 8815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:45.104140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:38178)
0808 07:05:45.104249 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:45.104296 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":50,"threads_started":1}
W20260808 07:05:45.104451 7646 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260808 07:05:45.104811 8815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:45.104715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:38192)
0808 07:05:45.104765 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:45.104791 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 07:05:45.104884 7646 leader_election.cc:334] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8caf019b6be6444081601acfda7fb6fc (127.29.82.126:43645): Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
I20260808 07:05:45.104925 7646 leader_election.cc:302] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a2cc406b6ed44508ad53d97451bb5171; no voters: 8caf019b6be6444081601acfda7fb6fc
I20260808 07:05:45.104983 8814 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:05:45.924206 8817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:45.923966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:43583)
0808 07:05:45.924103 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:45.924150 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260808 07:05:45.924437 8824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:45.924198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:46783)
0808 07:05:45.924342 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:45.924378 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":48,"threads_started":1}
I20260808 07:05:45.924556 8819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:45.924070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:39023)
0808 07:05:45.924342 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:45.924378 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":56,"threads_started":1}
I20260808 07:05:46.925186 8826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:46.924945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:49425)
0808 07:05:46.925077 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:46.925115 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":54,"threads_started":1}
I20260808 07:05:46.925079 8825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:46.924779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:58309)
0808 07:05:46.924959 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:46.925004 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":63,"threads_started":1}
I20260808 07:05:46.925293 8827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:46.925032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:48267)
0808 07:05:46.925220 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:46.925253 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":52,"threads_started":1}
I20260808 07:05:47.926052 8828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:47.925734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:35637)
0808 07:05:47.925941 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:47.925994 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":65,"threads_started":1}
I20260808 07:05:47.926072 8829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:47.925745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:48883)
0808 07:05:47.925977 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:47.926021 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":61,"threads_started":1}
I20260808 07:05:47.926200 8830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:47.925974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:53801)
0808 07:05:47.926130 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:47.926162 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":48,"threads_started":1}
I20260808 07:05:48.926924 8831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:48.926607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:57707)
0808 07:05:48.926764 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:48.926873 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":63,"threads_started":1}
I20260808 07:05:48.926909 8836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:48.926684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:51059)
0808 07:05:48.926814 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:48.926853 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":56,"threads_started":1}
I20260808 07:05:48.927187 8835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:48.926588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:39593)
0808 07:05:48.926961 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:48.927132 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":78,"threads_started":1}
I20260808 07:05:49.927745 8838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:49.927452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:54973)
0808 07:05:49.927636 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:49.927686 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":112,"threads_started":1}
I20260808 07:05:49.927836 8837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:49.927356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:52803)
0808 07:05:49.927762 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:49.927796 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":147,"threads_started":1}
I20260808 07:05:49.927898 8840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:49.927599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:48733)
0808 07:05:49.927813 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:49.927852 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":53,"threads_started":1}
I20260808 07:05:50.928483 8841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:50.928195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:42255)
0808 07:05:50.928379 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:50.928426 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":70,"threads_started":1}
I20260808 07:05:50.928711 8846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:50.928383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:44589)
0808 07:05:50.928628 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:50.928666 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":57,"threads_started":1}
I20260808 07:05:50.928710 8843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:50.928363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:48405)
0808 07:05:50.928646 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:50.928673 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":47,"threads_started":1}
I20260808 07:05:51.929497 8851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:51.929246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:59301)
0808 07:05:51.929376 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:51.929433 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":58,"threads_started":1}
I20260808 07:05:51.929679 8852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:51.929358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:54969)
0808 07:05:51.929524 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:51.929562 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":48,"threads_started":1}
I20260808 07:05:51.929755 8848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:51.929231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:53235)
0808 07:05:51.929602 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:51.929714 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":64,"threads_started":1}
I20260808 07:05:52.930269 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:52.930032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:60225)
0808 07:05:52.930169 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:52.930211 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":62,"threads_started":1}
I20260808 07:05:52.930311 8857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:52.930113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:49267)
0808 07:05:52.930225 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:52.930263 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":55,"threads_started":1}
I20260808 07:05:52.930369 8858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:52.930214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:50281)
0808 07:05:52.930304 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:52.930332 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76,"thread_start_us":40,"threads_started":1}
I20260808 07:05:53.930992 8859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:53.930689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:51201)
0808 07:05:53.930903 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:53.930949 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":79,"threads_started":1}
I20260808 07:05:53.930992 8860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:53.930740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:50535)
0808 07:05:53.930878 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:53.930934 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":41,"threads_started":1}
I20260808 07:05:53.931177 8861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:53.930960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:49509)
0808 07:05:53.931093 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:53.931129 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":70,"threads_started":1}
I20260808 07:05:54.931790 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:54.931577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:45237)
0808 07:05:54.931702 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:54.931738 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
I20260808 07:05:54.931790 8865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:54.931577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:54737)
0808 07:05:54.931702 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:54.931738 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":56,"threads_started":1}
I20260808 07:05:54.931798 8863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:54.931567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:56581)
0808 07:05:54.931707 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:54.931749 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":69,"threads_started":1}
I20260808 07:05:55.932485 8872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:55.932222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:46083)
0808 07:05:55.932400 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:55.932433 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":70,"threads_started":1}
I20260808 07:05:55.932513 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:55.932223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:52759)
0808 07:05:55.932425 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:55.932465 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":74,"threads_started":1}
I20260808 07:05:55.932485 8871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:55.932232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:58651)
0808 07:05:55.932387 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:55.932433 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":59,"threads_started":1}
I20260808 07:05:56.933135 8875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:56.932897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:60419)
0808 07:05:56.933033 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:56.933075 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":77,"threads_started":1}
I20260808 07:05:56.933373 8877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:56.933169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:57821)
0808 07:05:56.933288 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:56.933326 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":45,"threads_started":1}
I20260808 07:05:56.933468 8876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:56.933060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:47745)
0808 07:05:56.933374 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:56.933413 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":54,"threads_started":1}
I20260808 07:05:57.934031 8880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:57.933686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:51599)
0808 07:05:57.933925 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:57.933972 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":70,"threads_started":1}
I20260808 07:05:57.934057 8881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:57.933803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:37267)
0808 07:05:57.933959 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:57.934010 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":47,"threads_started":1}
I20260808 07:05:57.934351 8882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:57.933893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:60061)
0808 07:05:57.934270 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:57.934307 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":52,"threads_started":1}
I20260808 07:05:58.934942 8886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:58.934763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:56179)
0808 07:05:58.934859 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:58.934893 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":49,"threads_started":1}
I20260808 07:05:58.935007 8883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:58.934523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:43181)
0808 07:05:58.934777 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:58.934815 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":70,"threads_started":1}
I20260808 07:05:58.935223 8885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:58.934566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:39657)
0808 07:05:58.934677 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:58.934858 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":43,"threads_started":1}
I20260808 07:05:59.935827 8891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:59.935541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:34243)
0808 07:05:59.935723 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:59.935770 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":64,"threads_started":1}
I20260808 07:05:59.935863 8888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:59.935479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:35247)
0808 07:05:59.935775 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:59.935813 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":82,"threads_started":1}
I20260808 07:05:59.936133 8893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:59.935689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:40225)
0808 07:05:59.936056 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:59.936093 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":68,"threads_started":1}
I20260808 07:06:00.790915 8894 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8caf019b6be6444081601acfda7fb6fc)
I20260808 07:06:00.791033 8894 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "8caf019b6be6444081601acfda7fb6fc" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43645 } } peers { permanent_uuid: "a2cc406b6ed44508ad53d97451bb5171" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33931 } attrs { promote: false } } peers { permanent_uuid: "2a22889798274e50842d9218c2db742b" member_type: NON_VOTER last_known_addr { host: "127.29.82.124" port: 33505 } attrs { promote: true } }
I20260808 07:06:00.791215 8894 leader_election.cc:288] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8caf019b6be6444081601acfda7fb6fc (127.29.82.126:43645)
I20260808 07:06:00.791635 8896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:00.791376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:48580)
0808 07:06:00.791534 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:00.791577 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":95,"threads_started":1}
W20260808 07:06:00.791723 7646 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
I20260808 07:06:00.792111 8896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:00.792005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.0.0.1:48594)
0808 07:06:00.792059 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:00.792091 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 07:06:00.792186 7646 leader_election.cc:334] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8caf019b6be6444081601acfda7fb6fc (127.29.82.126:43645): Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
I20260808 07:06:00.792265 7646 leader_election.cc:302] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a2cc406b6ed44508ad53d97451bb5171; no voters: 8caf019b6be6444081601acfda7fb6fc
I20260808 07:06:00.792335 8894 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a2cc406b6ed44508ad53d97451bb5171 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:06:00.936713 8898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:00.936369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.66:40353)
0808 07:06:00.936573 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:00.936616 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":66,"threads_started":1}
I20260808 07:06:00.936731 8902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:00.936521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.67:52789)
0808 07:06:00.936644 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:00.936681 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":58,"threads_started":1}
I20260808 07:06:00.936816 8900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:00.936369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43645 (local address 127.29.82.65:38593)
0808 07:06:00.936520 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:00.936719 (+ 199us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:43645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":91,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:903: Failure
Failed
Bad status: Timed out: Could not connect to the cluster: ConnectToClusterRpc(addrs: 127.29.82.126:43645,127.29.82.125:33931,127.29.82.124:33505, num_attempts: 243) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.29.82.126:43645,127.29.82.125:33931,127.29.82.124:33505, num_attempts: 1)
I20260808 07:06:01.137171 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 7896
I20260808 07:06:01.150082 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 8239
I20260808 07:06:01.165084 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 8431
I20260808 07:06:01.176667 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 7454
I20260808 07:06:01.184435 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 7761
2026-08-08T07:06:01Z chronyd exiting
I20260808 07:06:01.205859 30025 test_util.cc:175] -----------------------------------------------
I20260808 07:06:01.205925 30025 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172701750152-30025-0
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (33221 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:01 dist-test-slave-rmhg krb5kdc[8906](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:01 dist-test-slave-rmhg krb5kdc[8906](info): set up 2 sockets
Aug 08 07:06:01 dist-test-slave-rmhg krb5kdc[8906](info): commencing operation
krb5kdc: starting...
W20260808 07:06:02.310771 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:06:02 dist-test-slave-rmhg krb5kdc[8906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:02Z Disabled control of system clock
WARNING: no policy specified for oryx/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.126.keytab.
Entry for principal oryx/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.126.keytab.
I20260808 07:06:02.435595 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:38621
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.126.keytab
--principal=oryx/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:38621
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:02.519440 8923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:02.519675 8923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:02.519706 8923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:02.520848 8923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:02.520890 8923 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 07:06:02.520906 8923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:02.520923 8923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:02.520937 8923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:02.520953 8923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:02.522563 8923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:38621
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.126.keytab
--principal=oryx/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:38621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:02.522817 8923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:02.523041 8923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:02.528280 8930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:02.528292 8935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:02.528363 8923 server_base.cc:1034] running on GCE node
W20260808 07:06:02.528308 8928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:02.528740 8923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:02.529024 8923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:02.530189 8923 hybrid_clock.cc:648] HybridClock initialized: now 1786172762530172 us; error 49 us; skew 500 ppm
Aug 08 07:06:02 dist-test-slave-rmhg krb5kdc[8906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172762, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:02.532817 8923 init.cc:377] Logged in from keytab as oryx/127.29.82.126@KRBTEST.COM (short username oryx)
I20260808 07:06:02.533321 8923 webserver.cc:460] Webserver started at http://127.29.82.126:35521/ using document root <none> and password file <none>
I20260808 07:06:02.533566 8923 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:02.533614 8923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:02.533738 8923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:02.534838 8923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "57fbb851d6364184b0f6f40c09c4c64a"
format_stamp: "Formatted at 2026-08-08 07:06:02 on dist-test-slave-rmhg"
server_key: "cc0ccc50b58175c52fb38fea98fe171f"
server_key_iv: "89ab180845cc63b0fd2dfa10df05986d"
server_key_version: "encryptionkey@0"
I20260808 07:06:02.535195 8923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "57fbb851d6364184b0f6f40c09c4c64a"
format_stamp: "Formatted at 2026-08-08 07:06:02 on dist-test-slave-rmhg"
server_key: "cc0ccc50b58175c52fb38fea98fe171f"
server_key_iv: "89ab180845cc63b0fd2dfa10df05986d"
server_key_version: "encryptionkey@0"
I20260808 07:06:02.536497 8923 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:06:02.537264 8943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:02.537400 8923 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:06:02.537485 8923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "57fbb851d6364184b0f6f40c09c4c64a"
format_stamp: "Formatted at 2026-08-08 07:06:02 on dist-test-slave-rmhg"
server_key: "cc0ccc50b58175c52fb38fea98fe171f"
server_key_iv: "89ab180845cc63b0fd2dfa10df05986d"
server_key_version: "encryptionkey@0"
I20260808 07:06:02.537580 8923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:02.550758 8923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:02.552932 8923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:02.553066 8923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:02.557746 8923 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:38621
I20260808 07:06:02.557834 9036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:38621 every 8 connection(s)
I20260808 07:06:02.558146 8923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:02.558852 9037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:02.561272 9037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a: Bootstrap starting.
I20260808 07:06:02.561384 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 8923
I20260808 07:06:02.561491 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:06:02.561690 30025 external_mini_cluster.cc:1428] Setting key e626e67a9fab5fef0599a5c0b2d43d35
I20260808 07:06:02.561959 9037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:02.562297 9037 log.cc:824] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:02.563190 9037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a: No bootstrap required, opened a new log
I20260808 07:06:02.564589 9037 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57fbb851d6364184b0f6f40c09c4c64a" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38621 } }
I20260808 07:06:02.564733 9037 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:02.564767 9037 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57fbb851d6364184b0f6f40c09c4c64a, State: Initialized, Role: FOLLOWER
I20260808 07:06:02.564901 9037 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57fbb851d6364184b0f6f40c09c4c64a" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38621 } }
I20260808 07:06:02.564981 9037 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:02.565014 9037 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:02.565073 9037 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:02.565860 9037 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57fbb851d6364184b0f6f40c09c4c64a" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38621 } }
I20260808 07:06:02.565981 9037 leader_election.cc:302] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57fbb851d6364184b0f6f40c09c4c64a; no voters:
I20260808 07:06:02.566212 9037 leader_election.cc:288] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:06:02.566294 9045 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:02.566563 9037 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:02.566545 9045 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [term 1 LEADER]: Becoming Leader. State: Replica: 57fbb851d6364184b0f6f40c09c4c64a, State: Running, Role: LEADER
I20260808 07:06:02.566735 9045 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57fbb851d6364184b0f6f40c09c4c64a" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38621 } }
I20260808 07:06:02.567114 9047 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57fbb851d6364184b0f6f40c09c4c64a. Latest consensus state: current_term: 1 leader_uuid: "57fbb851d6364184b0f6f40c09c4c64a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57fbb851d6364184b0f6f40c09c4c64a" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38621 } } }
I20260808 07:06:02.567190 9046 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57fbb851d6364184b0f6f40c09c4c64a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57fbb851d6364184b0f6f40c09c4c64a" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38621 } } }
I20260808 07:06:02.567303 9047 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:02.567392 9046 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:02.567652 9056 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:02.568238 9056 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 07:06:02 dist-test-slave-rmhg krb5kdc[8906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
I20260808 07:06:02.570204 9056 catalog_manager.cc:1347] Generated new cluster ID: bdf0f87cda4345349383a1d0e4877d6f
I20260808 07:06:02.570255 9056 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:06:02.573714 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:02.562231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52894 (local address 127.29.82.126:38621)
0808 07:06:02.562429 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:02.562440 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:02.562474 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:06:02.562933 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:02.562940 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:02.562991 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:02.563127 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:02.563793 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.565094 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.566145 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.566817 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.566925 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:02.569891 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:02.569896 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:02.569896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:02.569909 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:02.571913 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:02.572364 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:02.572367 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:02.572367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:02.572484 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:02.572686 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:02.572686 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:02.572687 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:02.572991 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:02.573144 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:02.573332 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 07:06:02.573485 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":89,"threads_started":1}
I20260808 07:06:02.577672 9056 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:02.578241 9056 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:02.582535 9056 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a: Generated new TSK 0
I20260808 07:06:02.582720 9056 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.65.keytab.
Entry for principal oryx/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.65.keytab.
I20260808 07:06:02.613658 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38621
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.65.keytab
--principal=oryx/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:02.701555 9078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:02.701795 9078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:02.701829 9078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:02.703025 9078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:02.703066 9078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:02.703094 9078 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:06:02.703116 9078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:06:02.704699 9078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.65.keytab
--principal=oryx/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.82.126:38621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:02.704950 9078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:02.705199 9078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:02.710238 9085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:02.710287 9083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:02.710250 9078 server_base.cc:1034] running on GCE node
W20260808 07:06:02.710289 9087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:02.710631 9078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:02.710866 9078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:02.712023 9078 hybrid_clock.cc:648] HybridClock initialized: now 1786172762712006 us; error 33 us; skew 500 ppm
Aug 08 07:06:02 dist-test-slave-rmhg krb5kdc[8906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172762, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:02.714699 9078 init.cc:377] Logged in from keytab as oryx/127.29.82.65@KRBTEST.COM (short username oryx)
I20260808 07:06:02.715094 9078 webserver.cc:460] Webserver started at http://127.29.82.65:37185/ using document root <none> and password file <none>
I20260808 07:06:02.715301 9078 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:02.715350 9078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:02.715457 9078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:02.716485 9078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "0d5cfcc5d11d421399e54ab3baefbf1a"
format_stamp: "Formatted at 2026-08-08 07:06:02 on dist-test-slave-rmhg"
server_key: "47e8507ae6cd8b861e7963ac55e7d9ba"
server_key_iv: "ea434f9e8fd9e2cc16c2ee00244922d8"
server_key_version: "encryptionkey@0"
I20260808 07:06:02.716831 9078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "0d5cfcc5d11d421399e54ab3baefbf1a"
format_stamp: "Formatted at 2026-08-08 07:06:02 on dist-test-slave-rmhg"
server_key: "47e8507ae6cd8b861e7963ac55e7d9ba"
server_key_iv: "ea434f9e8fd9e2cc16c2ee00244922d8"
server_key_version: "encryptionkey@0"
I20260808 07:06:02.718145 9078 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:06:02.718922 9095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:02.719084 9078 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:02.719177 9078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "0d5cfcc5d11d421399e54ab3baefbf1a"
format_stamp: "Formatted at 2026-08-08 07:06:02 on dist-test-slave-rmhg"
server_key: "47e8507ae6cd8b861e7963ac55e7d9ba"
server_key_iv: "ea434f9e8fd9e2cc16c2ee00244922d8"
server_key_version: "encryptionkey@0"
I20260808 07:06:02.719246 9078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:02.738914 9078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:02.741346 9078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:02.741505 9078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:02.742028 9078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:02.742069 9078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:02.742091 9078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:02.742103 9078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:06:02 dist-test-slave-rmhg krb5kdc[8906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172762, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
I20260808 07:06:02.749092 9078 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:43967
I20260808 07:06:02.749217 9263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:43967 every 8 connection(s)
I20260808 07:06:02.749586 9078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:06:02.750438 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 9078
I20260808 07:06:02.750586 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:06:02.750785 30025 external_mini_cluster.cc:1428] Setting key 6dc27a50cce7a1ac345349867fcdf390
I20260808 07:06:02.751832 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:02.742488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:48057 (local address 127.29.82.126:38621)
0808 07:06:02.742546 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:02.742549 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:02.742748 (+ 199us) server_negotiation.cc:407] Connection header received
0808 07:06:02.743239 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:02.743240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:02.743254 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:02.743331 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:02.744325 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.744858 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.745926 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.746145 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.746203 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:02.748935 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:02.748937 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:02.748938 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:02.748959 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:02.750542 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:02.750913 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:02.750914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:02.750915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:02.750977 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:02.751199 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:02.751200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:02.751201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:02.751320 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:02.751377 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:02.751646 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 07:06:02.751738 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:06:02.752004 9107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:02.742450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38621 (local address 127.29.82.65:48057)
0808 07:06:02.742615 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:02.742657 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:02.743148 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:02.743407 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:02.743411 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:02.743890 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:02.744215 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:02.744222 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.744951 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.744951 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:02.745838 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:02.745841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.746219 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.746219 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:02.746363 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:02.746862 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:02.746871 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:02.748817 (+ 1946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:02.750616 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:02.750623 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:02.750625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:02.750846 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:02.751039 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:02.751040 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:02.751040 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:02.751143 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:02.751375 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:02.751382 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:02.751522 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 07:06:02.751615 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 07:06:02.751782 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":83,"threads_started":1}
I20260808 07:06:02.752491 9264 heartbeater.cc:347] Connected to a master server at 127.29.82.126:38621
I20260808 07:06:02.752633 9264 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:02.752892 9264 heartbeater.cc:511] Master 127.29.82.126:38621 requested a full tablet report, sending...
I20260808 07:06:02.753815 8967 ts_manager.cc:194] Registered new tserver with Master: 0d5cfcc5d11d421399e54ab3baefbf1a (127.29.82.65:43967)
I20260808 07:06:02.754508 8967 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:48057
I20260808 07:06:02.759466 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:02.753522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:47081 (local address 127.29.82.126:38621)
0808 07:06:02.753568 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:02.753570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:02.753683 (+ 113us) server_negotiation.cc:407] Connection header received
0808 07:06:02.753731 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:02.753731 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:02.753743 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:02.753802 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:02.754138 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.754827 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.755771 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.756087 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.756167 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:02.757182 (+ 1015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:02.757184 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:02.757184 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:02.757191 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:02.758442 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:02.758748 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:02.758750 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:02.758750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:02.758806 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:02.758979 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:02.758980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:02.758980 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:02.759090 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:02.759145 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:02.759298 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 07:06:02.759371 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:06:02.759495 9274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:02.753442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38621 (local address 127.29.82.65:47081)
0808 07:06:02.753614 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:02.753625 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:02.753682 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:02.753805 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:02.753806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:02.753986 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:02.754063 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:02.754066 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.754929 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.754930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:02.755678 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:02.755681 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.756202 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.756204 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:02.756273 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:02.756739 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:02.756744 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:02.757058 (+ 314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:02.758521 (+ 1463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:02.758522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:02.758522 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:02.758687 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:02.758869 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:02.758870 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:02.758870 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:02.758930 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:02.759144 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:02.759145 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:02.759204 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 07:06:02.759265 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:06:02.759374 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":76,"threads_started":1}
WARNING: no policy specified for oryx/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.66.keytab.
Entry for principal oryx/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.66.keytab.
I20260808 07:06:02.778122 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38621
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.66.keytab
--principal=oryx/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:02.861857 9276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:02.862097 9276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:02.862124 9276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:02.863369 9276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:02.863415 9276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:02.863433 9276 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:06:02.863451 9276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:06:02.865106 9276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.66.keytab
--principal=oryx/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.82.126:38621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:02.865386 9276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:02.865613 9276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:02.871104 9287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:02.871104 9285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:02.871104 9282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:02.871466 9276 server_base.cc:1034] running on GCE node
I20260808 07:06:02.871709 9276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:02.871963 9276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:02.873116 9276 hybrid_clock.cc:648] HybridClock initialized: now 1786172762873111 us; error 40 us; skew 500 ppm
Aug 08 07:06:02 dist-test-slave-rmhg krb5kdc[8906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172762, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:02.875751 9276 init.cc:377] Logged in from keytab as oryx/127.29.82.66@KRBTEST.COM (short username oryx)
I20260808 07:06:02.876228 9276 webserver.cc:460] Webserver started at http://127.29.82.66:43041/ using document root <none> and password file <none>
I20260808 07:06:02.876475 9276 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:02.876529 9276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:02.876663 9276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:02.877815 9276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "6892713600d045668fcbcd227a65d870"
format_stamp: "Formatted at 2026-08-08 07:06:02 on dist-test-slave-rmhg"
server_key: "53345b11b11bfa9558bcac9803f4da76"
server_key_iv: "5201a252990567dc754f0d64347fa5ac"
server_key_version: "encryptionkey@0"
I20260808 07:06:02.878185 9276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "6892713600d045668fcbcd227a65d870"
format_stamp: "Formatted at 2026-08-08 07:06:02 on dist-test-slave-rmhg"
server_key: "53345b11b11bfa9558bcac9803f4da76"
server_key_iv: "5201a252990567dc754f0d64347fa5ac"
server_key_version: "encryptionkey@0"
I20260808 07:06:02.879525 9276 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:06:02.880255 9296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:02.880407 9276 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:02.880496 9276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "6892713600d045668fcbcd227a65d870"
format_stamp: "Formatted at 2026-08-08 07:06:02 on dist-test-slave-rmhg"
server_key: "53345b11b11bfa9558bcac9803f4da76"
server_key_iv: "5201a252990567dc754f0d64347fa5ac"
server_key_version: "encryptionkey@0"
I20260808 07:06:02.880559 9276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:02.898291 9276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:02.900408 9276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:02.900585 9276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:02.901108 9276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:02.901178 9276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:02.901211 9276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:02.901233 9276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:06:02 dist-test-slave-rmhg krb5kdc[8906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172762, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
I20260808 07:06:02.908598 9276 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:37513
I20260808 07:06:02.908672 9469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:37513 every 8 connection(s)
I20260808 07:06:02.908973 9276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:06:02.911616 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:02.901607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:48913 (local address 127.29.82.126:38621)
0808 07:06:02.901674 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:02.901676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:02.901905 (+ 229us) server_negotiation.cc:407] Connection header received
0808 07:06:02.902629 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:02.902631 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:02.902645 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:02.902710 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:02.903621 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.904410 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.906037 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.906258 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.906322 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:02.908937 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:02.908939 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:02.908939 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:02.908947 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:02.910277 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:02.910674 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:02.910676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:02.910676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:02.910741 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:02.910961 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:02.910962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:02.910963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:02.911090 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:02.911148 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:02.911416 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 07:06:02.911511 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:06:02.911780 9309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:02.901577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38621 (local address 127.29.82.66:48913)
0808 07:06:02.901756 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:02.901809 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:02.902478 (+ 669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:02.902799 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:02.902804 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:02.903209 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:02.903529 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:02.903537 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.904517 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.904519 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:02.905945 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:02.905949 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.906342 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.906343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:02.906503 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:02.907104 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:02.907115 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:02.908828 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:02.910354 (+ 1526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:02.910361 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:02.910363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:02.910601 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:02.910796 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:02.910796 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:02.910797 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:02.910907 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:02.911145 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:02.911151 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:02.911295 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 07:06:02.911389 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 07:06:02.911557 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":88,"threads_started":1}
I20260808 07:06:02.912266 9470 heartbeater.cc:347] Connected to a master server at 127.29.82.126:38621
I20260808 07:06:02.912354 9470 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:02.912559 9470 heartbeater.cc:511] Master 127.29.82.126:38621 requested a full tablet report, sending...
I20260808 07:06:02.913022 8966 ts_manager.cc:194] Registered new tserver with Master: 6892713600d045668fcbcd227a65d870 (127.29.82.66:37513)
I20260808 07:06:02.913605 8966 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:48913
I20260808 07:06:02.913920 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 9276
I20260808 07:06:02.914031 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:06:02.914245 30025 external_mini_cluster.cc:1428] Setting key 791e713b9b31d0bf729686b229def05c
I20260808 07:06:02.918934 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:02.913420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:58473 (local address 127.29.82.126:38621)
0808 07:06:02.913455 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:02.913457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:02.913603 (+ 146us) server_negotiation.cc:407] Connection header received
0808 07:06:02.913620 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:02.913621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:02.913629 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:02.913666 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:02.913985 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.914678 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.915462 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.915709 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.915778 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:02.916726 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:02.916728 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:02.916728 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:02.916736 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:02.917951 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:02.918278 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:02.918279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:02.918279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:02.918324 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:02.918490 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:02.918491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:02.918491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:02.918621 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:02.918668 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:02.918811 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 07:06:02.918869 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 07:06:02.918991 9480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:02.913369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38621 (local address 127.29.82.66:58473)
0808 07:06:02.913507 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:02.913516 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:02.913572 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:02.913673 (+ 101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:02.913674 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:02.913869 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:02.913930 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:02.913932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.914774 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.914775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:02.915390 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:02.915393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.915789 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.915790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:02.915844 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:02.916272 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:02.916277 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:02.916632 (+ 355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:02.918011 (+ 1379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:02.918012 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:02.918012 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:02.918215 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:02.918374 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:02.918374 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:02.918375 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:02.918440 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:02.918672 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:02.918673 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:02.918720 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 07:06:02.918790 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 07:06:02.918887 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
WARNING: no policy specified for oryx/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.67.keytab.
Entry for principal oryx/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.67.keytab.
I20260808 07:06:02.942133 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38621
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.67.keytab
--principal=oryx/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:03.028867 9483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:03.029090 9483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:03.029116 9483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:03.030344 9483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:03.030390 9483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:03.030411 9483 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:06:03.030427 9483 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:06:03.031986 9483 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.67.keytab
--principal=oryx/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.82.126:38621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:03.032212 9483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:03.032402 9483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:03.037515 9494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:03.037515 9499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:03.037581 9496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:03.037781 9483 server_base.cc:1034] running on GCE node
I20260808 07:06:03.038015 9483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:03.038229 9483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:03.039376 9483 hybrid_clock.cc:648] HybridClock initialized: now 1786172763039363 us; error 32 us; skew 500 ppm
Aug 08 07:06:03 dist-test-slave-rmhg krb5kdc[8906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172763, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:03.042055 9483 init.cc:377] Logged in from keytab as oryx/127.29.82.67@KRBTEST.COM (short username oryx)
I20260808 07:06:03.042507 9483 webserver.cc:460] Webserver started at http://127.29.82.67:37257/ using document root <none> and password file <none>
I20260808 07:06:03.042726 9483 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:03.042770 9483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:03.042898 9483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:03.044004 9483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "e9bf8a30eb84406fa379c96555932342"
format_stamp: "Formatted at 2026-08-08 07:06:03 on dist-test-slave-rmhg"
server_key: "fe2b90b41acf236ccbb81c7d89bb8088"
server_key_iv: "c3c32cbc7f6c62ffed8936b01a5b77d4"
server_key_version: "encryptionkey@0"
I20260808 07:06:03.044340 9483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "e9bf8a30eb84406fa379c96555932342"
format_stamp: "Formatted at 2026-08-08 07:06:03 on dist-test-slave-rmhg"
server_key: "fe2b90b41acf236ccbb81c7d89bb8088"
server_key_iv: "c3c32cbc7f6c62ffed8936b01a5b77d4"
server_key_version: "encryptionkey@0"
I20260808 07:06:03.045676 9483 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:06:03.046339 9506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:03.046476 9483 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:03.046607 9483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "e9bf8a30eb84406fa379c96555932342"
format_stamp: "Formatted at 2026-08-08 07:06:03 on dist-test-slave-rmhg"
server_key: "fe2b90b41acf236ccbb81c7d89bb8088"
server_key_iv: "c3c32cbc7f6c62ffed8936b01a5b77d4"
server_key_version: "encryptionkey@0"
I20260808 07:06:03.046671 9483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:03.077986 9483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:03.080236 9483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:03.080382 9483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:03.080920 9483 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:03.080973 9483 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:03.081007 9483 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:03.081024 9483 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:06:03 dist-test-slave-rmhg krb5kdc[8906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172763, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
I20260808 07:06:03.087993 9483 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:34025
I20260808 07:06:03.088104 9678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:34025 every 8 connection(s)
I20260808 07:06:03.088371 9483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:06:03.088539 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 9483
I20260808 07:06:03.088644 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:06:03.088825 30025 external_mini_cluster.cc:1428] Setting key d401ba9e30e50946e1923657a391aaa2
I20260808 07:06:03.091226 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.081396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:58063 (local address 127.29.82.126:38621)
0808 07:06:03.081463 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.081465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.081692 (+ 227us) server_negotiation.cc:407] Connection header received
0808 07:06:03.082444 (+ 752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.082446 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.082461 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.082518 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:03.083415 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.083999 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.085590 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.085786 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.085850 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.088497 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:03.088499 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:03.088499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:03.088507 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:03.089960 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:03.090403 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:03.090404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:03.090404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:03.090451 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:03.090625 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:03.090625 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:03.090625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:03.090725 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:03.090774 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.091100 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.091160 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:06:03.091432 9518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.081379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38621 (local address 127.29.82.67:58063)
0808 07:06:03.081549 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.081597 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:03.082292 (+ 695us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:03.082624 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:03.082630 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:03.082999 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:03.083326 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.083332 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.084101 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.084103 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.085510 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.085513 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.085887 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.085889 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.086023 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.086959 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:03.086968 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:03.088391 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:03.090104 (+ 1713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:03.090110 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:03.090112 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:03.090336 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:03.090484 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:03.090485 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:03.090485 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:03.090581 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:03.090805 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:03.090811 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:03.090984 (+ 173us) client_negotiation.cc:769] Sending connection context
0808 07:06:03.091086 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 07:06:03.091217 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
I20260808 07:06:03.091941 9679 heartbeater.cc:347] Connected to a master server at 127.29.82.126:38621
I20260808 07:06:03.092029 9679 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:03.092228 9679 heartbeater.cc:511] Master 127.29.82.126:38621 requested a full tablet report, sending...
I20260808 07:06:03.092622 8967 ts_manager.cc:194] Registered new tserver with Master: e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025)
I20260808 07:06:03.093111 8967 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:58063
I20260808 07:06:03.097884 9689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.092954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38621 (local address 127.29.82.67:40517)
0808 07:06:03.093082 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.093093 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:03.093172 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:03.093293 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:03.093294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:03.093466 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:03.093530 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.093531 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.094159 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.094160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.094673 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.094674 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.095012 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.095013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.095074 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.095435 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:03.095439 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:03.095705 (+ 266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:03.096900 (+ 1195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:03.096901 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:03.096902 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:03.097070 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:03.097279 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:03.097280 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:03.097280 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:03.097337 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:03.097561 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:03.097561 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:03.097608 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 07:06:03.097668 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 07:06:03.097771 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":73,"threads_started":1}
I20260808 07:06:03.097877 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.093004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:40517 (local address 127.29.82.126:38621)
0808 07:06:03.093042 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.093044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.093171 (+ 127us) server_negotiation.cc:407] Connection header received
0808 07:06:03.093229 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.093229 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.093239 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.093287 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:03.093596 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.094072 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.094742 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.094951 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.095005 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.095783 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:03.095784 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:03.095785 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:03.095792 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:03.096824 (+ 1032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:03.097135 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:03.097136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:03.097136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:03.097222 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:03.097388 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:03.097389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:03.097389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:03.097503 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:03.097559 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.097700 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.097768 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:06:03.100452 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:06:03 dist-test-slave-rmhg krb5kdc[8906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172763, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:06:03 dist-test-slave-rmhg krb5kdc[8906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:03 dist-test-slave-rmhg krb5kdc[8906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 07:06:03.122956 9040 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:03.117363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52896 (local address 127.29.82.126:38621)
0808 07:06:03.117416 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.117418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.117426 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:06:03.117452 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.117452 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.117498 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.117557 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:03.118157 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.118710 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.119456 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.119663 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.119727 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.122848 (+ 3121us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52896: BlockingRecv error: recv got EOF from 127.0.0.1:52896 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 08 07:06:03 dist-test-slave-rmhg krb5kdc[8906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172763, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
I20260808 07:06:03.130249 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.123702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52904 (local address 127.29.82.126:38621)
0808 07:06:03.123743 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.123745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.123843 (+ 98us) server_negotiation.cc:407] Connection header received
0808 07:06:03.123908 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.123908 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.123919 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.123962 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:03.124412 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.124946 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.125682 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.125889 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.125964 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.128034 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:03.128035 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:03.128036 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:03.128052 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:03.129266 (+ 1214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:03.129556 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:03.129558 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:03.129558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:03.129614 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:03.129782 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:03.129783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:03.129783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:03.129894 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:03.129986 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.130078 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.130154 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:06:03.131747 8967 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52904:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:06:03.133358 8967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:06:03.140177 9720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.135981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51002 (local address 127.29.82.67:34025)
0808 07:06:03.136331 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.136358 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.136370 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:06:03.136410 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.136412 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.136437 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.136647 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:03.136709 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.137839 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.138919 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.139689 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.139762 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.139846 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.140042 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.140082 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":87,"threads_started":1}
I20260808 07:06:03.140162 9722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.136078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:43967 (local address 127.0.0.1:49922)
0808 07:06:03.136197 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.136207 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:03.136251 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:03.136719 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:03.136720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:03.136723 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:03.136770 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.136771 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.137649 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.137650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.139086 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.139087 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.139791 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.139792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.139866 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.139883 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 07:06:03.139932 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:06:03.139988 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":34,"thread_start_us":77,"threads_started":1}
I20260808 07:06:03.140177 9716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.135676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:37513 (local address 127.0.0.1:36124)
0808 07:06:03.135812 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.135857 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:03.135922 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:03.136456 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:03.136460 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:03.136464 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:03.136546 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.136548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.137907 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.137908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.139005 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.139008 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.139892 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.139893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.139971 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.139978 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 07:06:03.140034 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 07:06:03.140076 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"mutex_wait_us":37,"thread_start_us":56,"threads_started":1}
I20260808 07:06:03.140215 9717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.135779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36124 (local address 127.29.82.66:37513)
0808 07:06:03.136041 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.136048 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.136059 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:06:03.136100 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.136103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.136119 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.136240 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:03.136630 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.137819 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.139087 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.139793 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.139884 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.139967 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.140048 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.140083 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":84,"threads_started":1}
I20260808 07:06:03.140087 9719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.135885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:34025 (local address 127.0.0.1:51002)
0808 07:06:03.136043 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.136051 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:03.136092 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:03.136546 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:03.136547 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:03.136549 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:03.136577 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.136578 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.137957 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.137958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.138844 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.138846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.139766 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.139767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.139866 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.139883 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 07:06:03.139959 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 07:06:03.139993 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":6,"thread_start_us":97,"threads_started":1}
I20260808 07:06:03.140563 9723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.136287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49922 (local address 127.29.82.65:43967)
0808 07:06:03.136530 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.136534 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.136544 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:06:03.136585 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.136587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.136602 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.136719 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:03.136822 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.137575 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.139143 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.139701 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.140289 (+ 588us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.140389 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.140416 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.140472 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":95,"threads_started":1}
I20260808 07:06:03.141557 9176 tablet_service.cc:1467] Processing CreateTablet for tablet 0b46d9d50f2c402d8e8a38ff1481007b (DEFAULT_TABLE table=test-table [id=5a32f31fadfb4041bccbe61da66c8b28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:03.141583 9572 tablet_service.cc:1467] Processing CreateTablet for tablet 0b46d9d50f2c402d8e8a38ff1481007b (DEFAULT_TABLE table=test-table [id=5a32f31fadfb4041bccbe61da66c8b28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:03.141583 9375 tablet_service.cc:1467] Processing CreateTablet for tablet 0b46d9d50f2c402d8e8a38ff1481007b (DEFAULT_TABLE table=test-table [id=5a32f31fadfb4041bccbe61da66c8b28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:03.141912 9176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b46d9d50f2c402d8e8a38ff1481007b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.141923 9375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b46d9d50f2c402d8e8a38ff1481007b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.141923 9572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b46d9d50f2c402d8e8a38ff1481007b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.145253 9724 tablet_bootstrap.cc:492] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a: Bootstrap starting.
I20260808 07:06:03.145751 9727 tablet_bootstrap.cc:492] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870: Bootstrap starting.
I20260808 07:06:03.146003 9724 tablet_bootstrap.cc:654] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.146337 9724 log.cc:824] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:03.146375 9727 tablet_bootstrap.cc:654] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.146696 9727 log.cc:824] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:03.146701 9726 tablet_bootstrap.cc:492] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342: Bootstrap starting.
I20260808 07:06:03.147120 9724 tablet_bootstrap.cc:492] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a: No bootstrap required, opened a new log
I20260808 07:06:03.147197 9724 ts_tablet_manager.cc:1397] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:06:03.147418 9726 tablet_bootstrap.cc:654] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.147462 9727 tablet_bootstrap.cc:492] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870: No bootstrap required, opened a new log
I20260808 07:06:03.147541 9727 ts_tablet_manager.cc:1397] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:06:03.147866 9726 log.cc:824] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:03.148649 9726 tablet_bootstrap.cc:492] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342: No bootstrap required, opened a new log
I20260808 07:06:03.148722 9726 ts_tablet_manager.cc:1397] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:06:03.148901 9724 raft_consensus.cc:348] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } }
I20260808 07:06:03.149034 9724 raft_consensus.cc:374] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.149078 9724 raft_consensus.cc:729] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5cfcc5d11d421399e54ab3baefbf1a, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.149232 9724 consensus_queue.cc:260] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } }
I20260808 07:06:03.149504 9724 ts_tablet_manager.cc:1428] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 07:06:03.149456 9727 raft_consensus.cc:348] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } }
I20260808 07:06:03.149632 9264 heartbeater.cc:503] Master 127.29.82.126:38621 was elected leader, sending a full tablet report...
I20260808 07:06:03.149654 9727 raft_consensus.cc:374] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.149693 9727 raft_consensus.cc:729] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892713600d045668fcbcd227a65d870, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.149803 9727 consensus_queue.cc:260] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } }
I20260808 07:06:03.150065 9727 ts_tablet_manager.cc:1428] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:06:03.150097 9470 heartbeater.cc:503] Master 127.29.82.126:38621 was elected leader, sending a full tablet report...
I20260808 07:06:03.151005 9726 raft_consensus.cc:348] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } }
I20260808 07:06:03.151124 9726 raft_consensus.cc:374] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.151154 9726 raft_consensus.cc:729] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9bf8a30eb84406fa379c96555932342, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.151257 9726 consensus_queue.cc:260] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } }
I20260808 07:06:03.151510 9726 ts_tablet_manager.cc:1428] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:06:03.151527 9679 heartbeater.cc:503] Master 127.29.82.126:38621 was elected leader, sending a full tablet report...
W20260808 07:06:03.159780 9471 tablet.cc:2369] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:06:03.250599 9265 tablet.cc:2369] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:06:03.339149 9681 tablet.cc:2369] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:06:03.374636 9735 raft_consensus.cc:482] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:06:03.374769 9735 raft_consensus.cc:504] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } }
I20260808 07:06:03.375138 9735 leader_election.cc:288] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025), 0d5cfcc5d11d421399e54ab3baefbf1a (127.29.82.65:43967)
I20260808 07:06:03.376117 9733 raft_consensus.cc:482] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:06:03.376232 9733 raft_consensus.cc:504] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } }
I20260808 07:06:03.376541 9733 leader_election.cc:288] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892713600d045668fcbcd227a65d870 (127.29.82.66:37513), e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025)
I20260808 07:06:03.378954 9309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.375351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:34025 (local address 127.29.82.66:44431)
0808 07:06:03.375443 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.375457 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:03.375527 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:03.375698 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:03.375700 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:03.375702 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:03.375782 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.375784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.376695 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.376696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.377938 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.377942 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.378676 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.378677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.378767 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.378771 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:06:03.378815 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:06:03.378859 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 07:06:03.378989 9723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.375578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:44959 (local address 127.29.82.65:43967)
0808 07:06:03.375662 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.375664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.375793 (+ 129us) server_negotiation.cc:407] Connection header received
0808 07:06:03.375841 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.375842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.375852 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.375906 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:03.376070 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.376761 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.378093 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.378624 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.378671 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.378679 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.378886 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.378921 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 07:06:03.379220 9720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.375472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:44431 (local address 127.29.82.67:34025)
0808 07:06:03.375534 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.375536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.375550 (+ 14us) server_negotiation.cc:407] Connection header received
0808 07:06:03.375597 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.375598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.375608 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.375658 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:03.375851 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.376620 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.378046 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.378557 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.378632 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.378643 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.379113 (+ 470us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.379155 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 07:06:03.379230 9738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.375485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:43967 (local address 127.29.82.66:44959)
0808 07:06:03.375715 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.375725 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:03.375784 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:03.375914 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:03.375915 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:03.375916 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:03.375985 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.375987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.376842 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.376843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.377989 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.377992 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.378736 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.378737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.378816 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.378819 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:06:03.379102 (+ 283us) client_negotiation.cc:240] Negotiation successful
0808 07:06:03.379142 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":157,"threads_started":1}
I20260808 07:06:03.379534 9614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b46d9d50f2c402d8e8a38ff1481007b" candidate_uuid: "6892713600d045668fcbcd227a65d870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9bf8a30eb84406fa379c96555932342" is_pre_election: true
I20260808 07:06:03.379612 9202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b46d9d50f2c402d8e8a38ff1481007b" candidate_uuid: "6892713600d045668fcbcd227a65d870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" is_pre_election: true
I20260808 07:06:03.379700 9614 raft_consensus.cc:2454] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6892713600d045668fcbcd227a65d870 in term 0.
I20260808 07:06:03.379714 9202 raft_consensus.cc:2454] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6892713600d045668fcbcd227a65d870 in term 0.
I20260808 07:06:03.379915 9300 leader_election.cc:302] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5cfcc5d11d421399e54ab3baefbf1a, 6892713600d045668fcbcd227a65d870; no voters:
I20260808 07:06:03.380119 9735 raft_consensus.cc:2781] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:06:03.380374 9717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.376754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:40471 (local address 127.29.82.66:37513)
0808 07:06:03.376930 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.376932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.376940 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:06:03.376959 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.376960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.376967 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.377015 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:03.377238 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.378212 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.379527 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.380017 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.380062 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.380071 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.380276 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.380313 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156}
I20260808 07:06:03.380375 9735 raft_consensus.cc:482] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:06:03.380435 9741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.376839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:34025 (local address 127.29.82.65:53479)
0808 07:06:03.377183 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.377192 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:03.377241 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:03.377450 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:03.377451 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:03.377452 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:03.377507 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.377508 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.378333 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.378334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.379435 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.379439 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.380183 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.380184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.380261 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.380266 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:06:03.380314 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 07:06:03.380354 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":3,"thread_start_us":48,"threads_started":1}
I20260808 07:06:03.380455 9735 raft_consensus.cc:3037] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.380620 9739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.376689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:37513 (local address 127.29.82.65:40471)
0808 07:06:03.376825 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.376835 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:03.376880 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:03.377056 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:03.377057 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:03.377059 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:03.377138 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.377139 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.378298 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.378299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.379438 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.379441 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.380139 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.380140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.380206 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.380210 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:06:03.380488 (+ 278us) client_negotiation.cc:240] Negotiation successful
0808 07:06:03.380534 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":57,"threads_started":1}
I20260808 07:06:03.380648 9743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.377022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:53479 (local address 127.29.82.67:34025)
0808 07:06:03.377329 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.377331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.377337 (+ 6us) server_negotiation.cc:407] Connection header received
0808 07:06:03.377357 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.377357 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.377365 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.377415 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:03.377581 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.378258 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.379529 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.380074 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.380140 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.380149 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.380520 (+ 371us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.380571 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":91,"threads_started":1}
I20260808 07:06:03.380831 9614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b46d9d50f2c402d8e8a38ff1481007b" candidate_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9bf8a30eb84406fa379c96555932342" is_pre_election: true
I20260808 07:06:03.380910 9614 raft_consensus.cc:2454] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d5cfcc5d11d421399e54ab3baefbf1a in term 0.
I20260808 07:06:03.380942 9399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b46d9d50f2c402d8e8a38ff1481007b" candidate_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892713600d045668fcbcd227a65d870" is_pre_election: true
I20260808 07:06:03.381071 9098 leader_election.cc:302] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5cfcc5d11d421399e54ab3baefbf1a, e9bf8a30eb84406fa379c96555932342; no voters:
I20260808 07:06:03.381228 9733 raft_consensus.cc:2781] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:06:03.381459 9733 raft_consensus.cc:482] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:06:03.381486 9733 raft_consensus.cc:3037] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.381695 9735 raft_consensus.cc:504] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } }
I20260808 07:06:03.381840 9399 raft_consensus.cc:2379] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d5cfcc5d11d421399e54ab3baefbf1a in current term 1: Already voted for candidate 6892713600d045668fcbcd227a65d870 in this term.
I20260808 07:06:03.381960 9614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b46d9d50f2c402d8e8a38ff1481007b" candidate_uuid: "6892713600d045668fcbcd227a65d870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9bf8a30eb84406fa379c96555932342"
I20260808 07:06:03.382042 9614 raft_consensus.cc:3037] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.382175 9735 leader_election.cc:288] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [CANDIDATE]: Term 1 election: Requested vote from peers e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025), 0d5cfcc5d11d421399e54ab3baefbf1a (127.29.82.65:43967)
I20260808 07:06:03.382496 9733 raft_consensus.cc:504] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } }
I20260808 07:06:03.382632 9733 leader_election.cc:288] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [CANDIDATE]: Term 1 election: Requested vote from peers 6892713600d045668fcbcd227a65d870 (127.29.82.66:37513), e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025)
I20260808 07:06:03.382771 9399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b46d9d50f2c402d8e8a38ff1481007b" candidate_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892713600d045668fcbcd227a65d870"
I20260808 07:06:03.382840 9399 raft_consensus.cc:2379] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d5cfcc5d11d421399e54ab3baefbf1a in current term 1: Already voted for candidate 6892713600d045668fcbcd227a65d870 in this term.
I20260808 07:06:03.382822 9613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b46d9d50f2c402d8e8a38ff1481007b" candidate_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9bf8a30eb84406fa379c96555932342"
I20260808 07:06:03.383076 9098 leader_election.cc:302] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d5cfcc5d11d421399e54ab3baefbf1a; no voters: 6892713600d045668fcbcd227a65d870, e9bf8a30eb84406fa379c96555932342
I20260808 07:06:03.383173 9733 raft_consensus.cc:2726] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260808 07:06:03.383206 9614 raft_consensus.cc:2454] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892713600d045668fcbcd227a65d870 in term 1.
I20260808 07:06:03.383296 9202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b46d9d50f2c402d8e8a38ff1481007b" candidate_uuid: "6892713600d045668fcbcd227a65d870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a"
I20260808 07:06:03.383344 9300 leader_election.cc:302] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892713600d045668fcbcd227a65d870, e9bf8a30eb84406fa379c96555932342; no voters:
I20260808 07:06:03.383374 9202 raft_consensus.cc:2379] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6892713600d045668fcbcd227a65d870 in current term 1: Already voted for candidate 0d5cfcc5d11d421399e54ab3baefbf1a in this term.
I20260808 07:06:03.383421 9735 raft_consensus.cc:2781] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:03.383512 9735 raft_consensus.cc:686] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 1 LEADER]: Becoming Leader. State: Replica: 6892713600d045668fcbcd227a65d870, State: Running, Role: LEADER
I20260808 07:06:03.383679 9735 consensus_queue.cc:237] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } }
I20260808 07:06:03.384541 8966 catalog_manager.cc:5495] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6892713600d045668fcbcd227a65d870 (127.29.82.66). New cstate: current_term: 1 leader_uuid: "6892713600d045668fcbcd227a65d870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260808 07:06:03.422906 9717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.420558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36136 (local address 127.29.82.66:37513)
0808 07:06:03.420628 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.420630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.420638 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:06:03.420694 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.420695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.420717 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.420776 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:03.420895 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.421391 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.422206 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.422408 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.422457 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.422604 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:03.422735 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:03.422795 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.422812 (+ 17us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.422833 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:06:03.424680 9202 raft_consensus.cc:1261] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Refusing update from remote peer 6892713600d045668fcbcd227a65d870: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:03.424728 9614 raft_consensus.cc:1261] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Refusing update from remote peer 6892713600d045668fcbcd227a65d870: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:03.424939 9735 consensus_queue.cc:1035] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:03.425082 9744 consensus_queue.cc:1035] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:03.427418 9749 mvcc.cc:205] Tried to move back new op lower bound from 7316163638984773632 to 7316163638820175872. Current Snapshot: MvccSnapshot[applied={T|T < 7316163638984773632}]
I20260808 07:06:03.427906 9750 mvcc.cc:205] Tried to move back new op lower bound from 7316163638984773632 to 7316163638820175872. Current Snapshot: MvccSnapshot[applied={T|T < 7316163638984773632 or (T in {7316163638984773632})}]
I20260808 07:06:03.429833 8967 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52904:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:06:03.429919 8967 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52904:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:06:03.430583 8967 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a: Sending DeleteTablet for 3 replicas of tablet 0b46d9d50f2c402d8e8a38ff1481007b
I20260808 07:06:03.430899 9375 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b46d9d50f2c402d8e8a38ff1481007b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:03 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:36124
I20260808 07:06:03.431016 9176 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b46d9d50f2c402d8e8a38ff1481007b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:03 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:49922
I20260808 07:06:03.431128 9572 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b46d9d50f2c402d8e8a38ff1481007b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:03 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:51002
I20260808 07:06:03.431281 9759 tablet_replica.cc:330] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a: stopping tablet replica
I20260808 07:06:03.431321 9758 tablet_replica.cc:330] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870: stopping tablet replica
I20260808 07:06:03.431391 9758 raft_consensus.cc:2229] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:06:03.431391 9759 raft_consensus.cc:2229] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:06:03.431375 8967 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52904:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 07:06:03.431470 9758 raft_consensus.cc:2258] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:06:03.431488 9759 raft_consensus.cc:2258] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 07:06:03.431535 8967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:06:03.431625 9760 tablet_replica.cc:330] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342: stopping tablet replica
I20260808 07:06:03.431716 9760 raft_consensus.cc:2229] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:06:03.431816 9760 raft_consensus.cc:2258] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:06:03.432170 9759 ts_tablet_manager.cc:1905] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:06:03.432170 9760 ts_tablet_manager.cc:1905] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:06:03.433357 9176 tablet_service.cc:1467] Processing CreateTablet for tablet 0478ecc2eb1e414ca261c6182fe92953 (DEFAULT_TABLE table=test-table [id=91a34a1c059948a4873039e3fba1c7b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:03.433481 9176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0478ecc2eb1e414ca261c6182fe92953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.433836 9760 ts_tablet_manager.cc:1918] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:06:03.433899 9760 log.cc:1196] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/0b46d9d50f2c402d8e8a38ff1481007b
I20260808 07:06:03.434141 9760 ts_tablet_manager.cc:1939] T 0b46d9d50f2c402d8e8a38ff1481007b P e9bf8a30eb84406fa379c96555932342: Deleting consensus metadata
I20260808 07:06:03.434394 9375 tablet_service.cc:1467] Processing CreateTablet for tablet 0478ecc2eb1e414ca261c6182fe92953 (DEFAULT_TABLE table=test-table [id=91a34a1c059948a4873039e3fba1c7b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:03.434518 9375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0478ecc2eb1e414ca261c6182fe92953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.434577 9758 ts_tablet_manager.cc:1905] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:06:03.435681 9758 ts_tablet_manager.cc:1918] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:06:03.435734 9758 log.cc:1196] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/0b46d9d50f2c402d8e8a38ff1481007b
I20260808 07:06:03.435895 9727 tablet_bootstrap.cc:492] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870: Bootstrap starting.
I20260808 07:06:03.436103 9759 ts_tablet_manager.cc:1918] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:06:03.436156 9759 log.cc:1196] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/wal/wals/0b46d9d50f2c402d8e8a38ff1481007b
I20260808 07:06:03.436318 9759 ts_tablet_manager.cc:1939] T 0b46d9d50f2c402d8e8a38ff1481007b P 0d5cfcc5d11d421399e54ab3baefbf1a: Deleting consensus metadata
I20260808 07:06:03.436324 9727 tablet_bootstrap.cc:654] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.436921 8947 catalog_manager.cc:4841] TS e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025): tablet 0b46d9d50f2c402d8e8a38ff1481007b (table test-table [id=5a32f31fadfb4041bccbe61da66c8b28]) successfully deleted
I20260808 07:06:03.436964 9727 tablet_bootstrap.cc:492] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870: No bootstrap required, opened a new log
I20260808 07:06:03.436950 9572 tablet_service.cc:1467] Processing CreateTablet for tablet 0478ecc2eb1e414ca261c6182fe92953 (DEFAULT_TABLE table=test-table [id=91a34a1c059948a4873039e3fba1c7b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:03.437000 9727 ts_tablet_manager.cc:1397] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:03.437032 8947 catalog_manager.cc:4841] TS 0d5cfcc5d11d421399e54ab3baefbf1a (127.29.82.65:43967): tablet 0b46d9d50f2c402d8e8a38ff1481007b (table test-table [id=5a32f31fadfb4041bccbe61da66c8b28]) successfully deleted
I20260808 07:06:03.437059 9572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0478ecc2eb1e414ca261c6182fe92953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.437141 9727 raft_consensus.cc:348] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.437255 9727 raft_consensus.cc:374] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.437274 9727 raft_consensus.cc:729] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892713600d045668fcbcd227a65d870, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.437314 9727 consensus_queue.cc:260] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.437386 9727 ts_tablet_manager.cc:1428] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 07:06:03.438110 9726 tablet_bootstrap.cc:492] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342: Bootstrap starting.
I20260808 07:06:03.438529 9726 tablet_bootstrap.cc:654] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.439023 9724 tablet_bootstrap.cc:492] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a: Bootstrap starting.
I20260808 07:06:03.439116 9726 tablet_bootstrap.cc:492] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342: No bootstrap required, opened a new log
I20260808 07:06:03.439155 9726 ts_tablet_manager.cc:1397] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:03.439308 9726 raft_consensus.cc:348] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.439370 9726 raft_consensus.cc:374] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.439389 9726 raft_consensus.cc:729] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9bf8a30eb84406fa379c96555932342, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.439399 9724 tablet_bootstrap.cc:654] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.435895 9758 ts_tablet_manager.cc:1939] T 0b46d9d50f2c402d8e8a38ff1481007b P 6892713600d045668fcbcd227a65d870: Deleting consensus metadata
I20260808 07:06:03.439433 9726 consensus_queue.cc:260] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.439520 9726 ts_tablet_manager.cc:1428] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:03.439889 8947 catalog_manager.cc:4841] TS 6892713600d045668fcbcd227a65d870 (127.29.82.66:37513): tablet 0b46d9d50f2c402d8e8a38ff1481007b (table test-table [id=5a32f31fadfb4041bccbe61da66c8b28]) successfully deleted
I20260808 07:06:03.440171 9724 tablet_bootstrap.cc:492] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a: No bootstrap required, opened a new log
I20260808 07:06:03.440212 9724 ts_tablet_manager.cc:1397] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 07:06:03.440348 9724 raft_consensus.cc:348] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.440403 9724 raft_consensus.cc:374] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.440415 9724 raft_consensus.cc:729] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5cfcc5d11d421399e54ab3baefbf1a, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.440452 9724 consensus_queue.cc:260] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.440534 9724 ts_tablet_manager.cc:1428] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:03.446641 9735 raft_consensus.cc:482] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:06:03.446707 9735 raft_consensus.cc:504] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.446822 9735 leader_election.cc:288] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d5cfcc5d11d421399e54ab3baefbf1a (127.29.82.65:43967), e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025)
I20260808 07:06:03.447026 9614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0478ecc2eb1e414ca261c6182fe92953" candidate_uuid: "6892713600d045668fcbcd227a65d870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9bf8a30eb84406fa379c96555932342" is_pre_election: true
I20260808 07:06:03.447129 9614 raft_consensus.cc:2454] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6892713600d045668fcbcd227a65d870 in term 0.
I20260808 07:06:03.447229 9202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0478ecc2eb1e414ca261c6182fe92953" candidate_uuid: "6892713600d045668fcbcd227a65d870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" is_pre_election: true
I20260808 07:06:03.447268 9300 leader_election.cc:302] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892713600d045668fcbcd227a65d870, e9bf8a30eb84406fa379c96555932342; no voters:
I20260808 07:06:03.447304 9202 raft_consensus.cc:2454] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6892713600d045668fcbcd227a65d870 in term 0.
I20260808 07:06:03.447371 9735 raft_consensus.cc:2781] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:06:03.447405 9735 raft_consensus.cc:482] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:06:03.447422 9735 raft_consensus.cc:3037] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.448035 9735 raft_consensus.cc:504] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.448141 9735 leader_election.cc:288] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [CANDIDATE]: Term 1 election: Requested vote from peers 0d5cfcc5d11d421399e54ab3baefbf1a (127.29.82.65:43967), e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025)
I20260808 07:06:03.448298 9202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0478ecc2eb1e414ca261c6182fe92953" candidate_uuid: "6892713600d045668fcbcd227a65d870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a"
I20260808 07:06:03.448318 9614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0478ecc2eb1e414ca261c6182fe92953" candidate_uuid: "6892713600d045668fcbcd227a65d870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9bf8a30eb84406fa379c96555932342"
I20260808 07:06:03.448390 9614 raft_consensus.cc:3037] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.448390 9202 raft_consensus.cc:3037] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.448949 9614 raft_consensus.cc:2454] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892713600d045668fcbcd227a65d870 in term 1.
I20260808 07:06:03.449102 9300 leader_election.cc:302] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892713600d045668fcbcd227a65d870, e9bf8a30eb84406fa379c96555932342; no voters:
I20260808 07:06:03.449198 9735 raft_consensus.cc:2781] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:03.449194 9202 raft_consensus.cc:2454] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892713600d045668fcbcd227a65d870 in term 1.
I20260808 07:06:03.449249 9735 raft_consensus.cc:686] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [term 1 LEADER]: Becoming Leader. State: Replica: 6892713600d045668fcbcd227a65d870, State: Running, Role: LEADER
I20260808 07:06:03.449294 9735 consensus_queue.cc:237] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.449839 8967 catalog_manager.cc:5495] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6892713600d045668fcbcd227a65d870 (127.29.82.66). New cstate: current_term: 1 leader_uuid: "6892713600d045668fcbcd227a65d870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } health_report { overall_health: UNKNOWN } } }
Aug 08 07:06:03 dist-test-slave-rmhg krb5kdc[8906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172762, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.126@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
I20260808 07:06:03.485771 9773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.477955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38621 (local address 127.0.0.1:52918)
0808 07:06:03.478130 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.478142 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:03.478228 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:03.478380 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:03.478380 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:03.478821 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:03.478884 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.478886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.479538 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.479539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.480413 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.480415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.480767 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.480768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.480830 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.481446 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:03.481451 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:03.483135 (+ 1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:03.484788 (+ 1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:03.484796 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:03.484798 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:03.485003 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:03.485206 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:03.485206 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:03.485206 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:03.485277 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:03.485504 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:03.485509 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:03.485553 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 07:06:03.485598 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:06:03.485693 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":78,"threads_started":1}
I20260808 07:06:03.485872 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.478010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52918 (local address 127.29.82.126:38621)
0808 07:06:03.478076 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.478078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.478235 (+ 157us) server_negotiation.cc:407] Connection header received
0808 07:06:03.478289 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.478290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.478301 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.478359 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:03.478967 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.479464 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.480501 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.480705 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.480751 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.483218 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:03.483220 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:03.483220 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:03.483227 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:03.484721 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:03.485067 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:03.485068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:03.485068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:03.485128 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:03.485322 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:03.485322 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:03.485323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:03.485452 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:03.485516 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.485632 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.485751 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":37}
I20260808 07:06:03.487840 8967 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:52918:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 07:06:03.488077 8967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:06:03.489672 9176 tablet_service.cc:1467] Processing CreateTablet for tablet 8406c545047e43b98fa3ec54b1657bbc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=cb84abcb2e6e441d890e4a05f26efa35]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:06:03.489675 9375 tablet_service.cc:1467] Processing CreateTablet for tablet 8406c545047e43b98fa3ec54b1657bbc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=cb84abcb2e6e441d890e4a05f26efa35]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:06:03.489830 9375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8406c545047e43b98fa3ec54b1657bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.489832 9176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8406c545047e43b98fa3ec54b1657bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.490983 9724 tablet_bootstrap.cc:492] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a: Bootstrap starting.
I20260808 07:06:03.491345 9572 tablet_service.cc:1467] Processing CreateTablet for tablet 8406c545047e43b98fa3ec54b1657bbc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=cb84abcb2e6e441d890e4a05f26efa35]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:06:03.491446 9724 tablet_bootstrap.cc:654] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.491529 9572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8406c545047e43b98fa3ec54b1657bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.492058 9724 tablet_bootstrap.cc:492] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a: No bootstrap required, opened a new log
I20260808 07:06:03.492105 9724 ts_tablet_manager.cc:1397] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 07:06:03.492250 9724 raft_consensus.cc:348] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.492317 9724 raft_consensus.cc:374] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.492349 9724 raft_consensus.cc:729] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5cfcc5d11d421399e54ab3baefbf1a, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.492391 9724 consensus_queue.cc:260] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.492475 9724 ts_tablet_manager.cc:1428] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:03.492609 9733 tablet_replica.cc:439] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } }
I20260808 07:06:03.492669 9733 tablet_replica.cc:442] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:06:03.492969 9726 tablet_bootstrap.cc:492] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342: Bootstrap starting.
I20260808 07:06:03.492983 9727 tablet_bootstrap.cc:492] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870: Bootstrap starting.
I20260808 07:06:03.493316 9727 tablet_bootstrap.cc:654] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.493414 9726 tablet_bootstrap.cc:654] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.494115 9726 tablet_bootstrap.cc:492] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342: No bootstrap required, opened a new log
I20260808 07:06:03.494163 9726 ts_tablet_manager.cc:1397] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 07:06:03.494303 9727 tablet_bootstrap.cc:492] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870: No bootstrap required, opened a new log
I20260808 07:06:03.494342 9727 ts_tablet_manager.cc:1397] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 07:06:03.494305 9726 raft_consensus.cc:348] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.494369 9726 raft_consensus.cc:374] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.494388 9726 raft_consensus.cc:729] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9bf8a30eb84406fa379c96555932342, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.494439 9726 consensus_queue.cc:260] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.494454 9727 raft_consensus.cc:348] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.494511 9727 raft_consensus.cc:374] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.494529 9727 raft_consensus.cc:729] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892713600d045668fcbcd227a65d870, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.494534 9726 ts_tablet_manager.cc:1428] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:03.494570 9727 consensus_queue.cc:260] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.494656 9727 ts_tablet_manager.cc:1428] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:03.494673 9735 tablet_replica.cc:439] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } }
I20260808 07:06:03.494735 9735 tablet_replica.cc:442] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:06:03.494761 9736 tablet_replica.cc:439] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } }
I20260808 07:06:03.494858 9736 tablet_replica.cc:442] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:06:03.636370 9735 raft_consensus.cc:482] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:06:03.636466 9735 raft_consensus.cc:504] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.636628 9735 leader_election.cc:288] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d5cfcc5d11d421399e54ab3baefbf1a (127.29.82.65:43967), e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025)
I20260808 07:06:03.636858 9202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8406c545047e43b98fa3ec54b1657bbc" candidate_uuid: "6892713600d045668fcbcd227a65d870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" is_pre_election: true
I20260808 07:06:03.636948 9202 raft_consensus.cc:2454] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6892713600d045668fcbcd227a65d870 in term 0.
I20260808 07:06:03.636883 9614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8406c545047e43b98fa3ec54b1657bbc" candidate_uuid: "6892713600d045668fcbcd227a65d870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9bf8a30eb84406fa379c96555932342" is_pre_election: true
I20260808 07:06:03.636994 9614 raft_consensus.cc:2454] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6892713600d045668fcbcd227a65d870 in term 0.
I20260808 07:06:03.637113 9300 leader_election.cc:302] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5cfcc5d11d421399e54ab3baefbf1a, 6892713600d045668fcbcd227a65d870; no voters:
I20260808 07:06:03.637251 9735 raft_consensus.cc:2781] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:06:03.637305 9735 raft_consensus.cc:482] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:06:03.637328 9735 raft_consensus.cc:3037] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.638012 9735 raft_consensus.cc:504] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.638120 9735 leader_election.cc:288] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [CANDIDATE]: Term 1 election: Requested vote from peers 0d5cfcc5d11d421399e54ab3baefbf1a (127.29.82.65:43967), e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025)
I20260808 07:06:03.638324 9202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8406c545047e43b98fa3ec54b1657bbc" candidate_uuid: "6892713600d045668fcbcd227a65d870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a"
I20260808 07:06:03.638327 9614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8406c545047e43b98fa3ec54b1657bbc" candidate_uuid: "6892713600d045668fcbcd227a65d870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9bf8a30eb84406fa379c96555932342"
I20260808 07:06:03.638392 9202 raft_consensus.cc:3037] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.638402 9614 raft_consensus.cc:3037] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.638960 9202 raft_consensus.cc:2454] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892713600d045668fcbcd227a65d870 in term 1.
I20260808 07:06:03.639026 9614 raft_consensus.cc:2454] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892713600d045668fcbcd227a65d870 in term 1.
I20260808 07:06:03.639122 9300 leader_election.cc:302] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5cfcc5d11d421399e54ab3baefbf1a, 6892713600d045668fcbcd227a65d870; no voters:
I20260808 07:06:03.639221 9735 raft_consensus.cc:2781] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:03.639278 9735 raft_consensus.cc:686] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [term 1 LEADER]: Becoming Leader. State: Replica: 6892713600d045668fcbcd227a65d870, State: Running, Role: LEADER
I20260808 07:06:03.639333 9735 consensus_queue.cc:237] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.639643 9744 tablet_replica.cc:439] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870: TxnStatusTablet state changed. Reason: New leader 6892713600d045668fcbcd227a65d870. Latest consensus state: current_term: 1 leader_uuid: "6892713600d045668fcbcd227a65d870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } }
I20260808 07:06:03.639735 9744 tablet_replica.cc:442] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:06:03.639920 9779 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 07:06:03.640046 9779 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 07:06:03.640211 8967 catalog_manager.cc:5495] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6892713600d045668fcbcd227a65d870 (127.29.82.66). New cstate: current_term: 1 leader_uuid: "6892713600d045668fcbcd227a65d870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } health_report { overall_health: UNKNOWN } } }
I20260808 07:06:03.676400 9773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.674122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:37513 (local address 127.0.0.1:36144)
0808 07:06:03.674209 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.674220 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:03.674269 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:03.674414 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:03.674414 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:03.674415 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:06:03.674471 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.674473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.675080 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.675081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.675658 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.675660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.675987 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.675988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.676055 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.676071 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:06:03.676229 (+ 158us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:06:03.676237 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 07:06:03.676276 (+ 39us) client_negotiation.cc:240] Negotiation successful
0808 07:06:03.676330 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 07:06:03.676391 9717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.674197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36144 (local address 127.29.82.66:37513)
0808 07:06:03.674259 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.674261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.674270 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:06:03.674332 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.674333 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.674346 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.674395 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:03.674529 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.675001 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.675730 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.675919 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.675974 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.676141 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:03.676176 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:03.676216 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.676279 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.676302 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 07:06:03.677557 9614 raft_consensus.cc:1261] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Refusing update from remote peer 6892713600d045668fcbcd227a65d870: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:03.677567 9202 raft_consensus.cc:1261] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Refusing update from remote peer 6892713600d045668fcbcd227a65d870: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:03.677801 9744 consensus_queue.cc:1035] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:03.677906 9735 consensus_queue.cc:1035] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:03.678493 9736 tablet_replica.cc:439] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342: TxnStatusTablet state changed. Reason: New leader 6892713600d045668fcbcd227a65d870. Latest consensus state: current_term: 1 leader_uuid: "6892713600d045668fcbcd227a65d870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } }
I20260808 07:06:03.678586 9736 tablet_replica.cc:442] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:06:03.678810 9733 tablet_replica.cc:439] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a: TxnStatusTablet state changed. Reason: New leader 6892713600d045668fcbcd227a65d870. Latest consensus state: current_term: 1 leader_uuid: "6892713600d045668fcbcd227a65d870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } }
I20260808 07:06:03.678898 9733 tablet_replica.cc:442] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:06:03.679546 9744 tablet_replica.cc:439] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6892713600d045668fcbcd227a65d870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } }
I20260808 07:06:03.679631 9744 tablet_replica.cc:442] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:06:03.679553 9735 tablet_replica.cc:439] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6892713600d045668fcbcd227a65d870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } }
I20260808 07:06:03.679824 9735 tablet_replica.cc:442] T 8406c545047e43b98fa3ec54b1657bbc P 6892713600d045668fcbcd227a65d870: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:06:03.680225 9733 tablet_replica.cc:439] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6892713600d045668fcbcd227a65d870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } }
I20260808 07:06:03.680315 9733 tablet_replica.cc:442] T 8406c545047e43b98fa3ec54b1657bbc P 0d5cfcc5d11d421399e54ab3baefbf1a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:06:03.680807 9751 mvcc.cc:205] Tried to move back new op lower bound from 7316163640021217280 to 7316163639867031552. Current Snapshot: MvccSnapshot[applied={T|T < 7316163640021217280}]
I20260808 07:06:03.680977 9736 tablet_replica.cc:439] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6892713600d045668fcbcd227a65d870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } } }
I20260808 07:06:03.681052 9736 tablet_replica.cc:442] T 8406c545047e43b98fa3ec54b1657bbc P e9bf8a30eb84406fa379c96555932342: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:06:03.685932 9717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.683311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:60987 (local address 127.29.82.66:37513)
0808 07:06:03.683356 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.683358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.683482 (+ 124us) server_negotiation.cc:407] Connection header received
0808 07:06:03.683541 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.683542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.683550 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.683595 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:03.683709 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.684182 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.685294 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.685482 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.685546 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.685706 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:03.685733 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:03.685766 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.685816 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.685854 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":15,"server-negotiator.queue_time_us":22}
I20260808 07:06:03.686024 9790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.683259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:37513 (local address 127.29.82.66:60987)
0808 07:06:03.683424 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.683435 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:03.683497 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:03.683599 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:03.683600 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:03.683602 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:06:03.683656 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.683658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.684235 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.684236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.685221 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.685225 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.685553 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.685554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.685610 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.685628 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:06:03.685768 (+ 140us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:06:03.685770 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:06:03.685814 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:06:03.685875 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":3,"thread_start_us":82,"threads_started":1}
I20260808 07:06:03.688172 9202 raft_consensus.cc:1261] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Refusing update from remote peer 6892713600d045668fcbcd227a65d870: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:03.688199 9614 raft_consensus.cc:1261] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Refusing update from remote peer 6892713600d045668fcbcd227a65d870: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:03.688385 9785 consensus_queue.cc:1035] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:03.688511 9735 consensus_queue.cc:1035] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:03.699729 8966 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52904:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:06:03.699832 8966 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52904:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:06:03.700407 8966 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a: Sending DeleteTablet for 3 replicas of tablet 0478ecc2eb1e414ca261c6182fe92953
I20260808 07:06:03.700635 9176 tablet_service.cc:1514] Processing DeleteTablet for tablet 0478ecc2eb1e414ca261c6182fe92953 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:03 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:49922
I20260808 07:06:03.700738 9759 tablet_replica.cc:330] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a: stopping tablet replica
I20260808 07:06:03.700730 9572 tablet_service.cc:1514] Processing DeleteTablet for tablet 0478ecc2eb1e414ca261c6182fe92953 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:03 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:51002
I20260808 07:06:03.700781 9759 raft_consensus.cc:2229] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:06:03.700819 9759 raft_consensus.cc:2258] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:06:03.700836 9760 tablet_replica.cc:330] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342: stopping tablet replica
I20260808 07:06:03.700887 9760 raft_consensus.cc:2229] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:06:03.700918 9760 raft_consensus.cc:2258] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:06:03.700901 9375 tablet_service.cc:1514] Processing DeleteTablet for tablet 0478ecc2eb1e414ca261c6182fe92953 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:03 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:36124
I20260808 07:06:03.701011 9758 tablet_replica.cc:330] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870: stopping tablet replica
I20260808 07:06:03.701084 9758 raft_consensus.cc:2229] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:06:03.701139 9758 raft_consensus.cc:2258] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:06:03.701274 9760 ts_tablet_manager.cc:1905] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:06:03.701402 9759 ts_tablet_manager.cc:1905] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:06:03.701431 9758 ts_tablet_manager.cc:1905] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:06:03.703140 9760 ts_tablet_manager.cc:1918] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:06:03.703140 9758 ts_tablet_manager.cc:1918] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:06:03.703198 9760 log.cc:1196] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/0478ecc2eb1e414ca261c6182fe92953
I20260808 07:06:03.703198 9758 log.cc:1196] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/0478ecc2eb1e414ca261c6182fe92953
I20260808 07:06:03.703408 9760 ts_tablet_manager.cc:1939] T 0478ecc2eb1e414ca261c6182fe92953 P e9bf8a30eb84406fa379c96555932342: Deleting consensus metadata
I20260808 07:06:03.703408 9758 ts_tablet_manager.cc:1939] T 0478ecc2eb1e414ca261c6182fe92953 P 6892713600d045668fcbcd227a65d870: Deleting consensus metadata
I20260808 07:06:03.703722 9759 ts_tablet_manager.cc:1918] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:06:03.703724 8947 catalog_manager.cc:4841] TS 6892713600d045668fcbcd227a65d870 (127.29.82.66:37513): tablet 0478ecc2eb1e414ca261c6182fe92953 (table test-table [id=91a34a1c059948a4873039e3fba1c7b4]) successfully deleted
I20260808 07:06:03.703778 9759 log.cc:1196] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/wal/wals/0478ecc2eb1e414ca261c6182fe92953
I20260808 07:06:03.703784 8947 catalog_manager.cc:4841] TS e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025): tablet 0478ecc2eb1e414ca261c6182fe92953 (table test-table [id=91a34a1c059948a4873039e3fba1c7b4]) successfully deleted
I20260808 07:06:03.703969 9759 ts_tablet_manager.cc:1939] T 0478ecc2eb1e414ca261c6182fe92953 P 0d5cfcc5d11d421399e54ab3baefbf1a: Deleting consensus metadata
I20260808 07:06:03.704308 8947 catalog_manager.cc:4841] TS 0d5cfcc5d11d421399e54ab3baefbf1a (127.29.82.65:43967): tablet 0478ecc2eb1e414ca261c6182fe92953 (table test-table [id=91a34a1c059948a4873039e3fba1c7b4]) successfully deleted
Aug 08 07:06:03 dist-test-slave-rmhg krb5kdc[8906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:06:03 dist-test-slave-rmhg krb5kdc[8906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:03 dist-test-slave-rmhg krb5kdc[8906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 07:06:03.726423 9040 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:03.720209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52922 (local address 127.29.82.126:38621)
0808 07:06:03.720269 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.720271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.720355 (+ 84us) server_negotiation.cc:407] Connection header received
0808 07:06:03.720404 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.720405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.720417 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.720497 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:03.721218 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.722049 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.722869 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.723182 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.723275 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.726350 (+ 3075us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52922: BlockingRecv error: recv got EOF from 127.0.0.1:52922 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 08 07:06:03 dist-test-slave-rmhg krb5kdc[8906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM
I20260808 07:06:03.734513 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.727349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52924 (local address 127.29.82.126:38621)
0808 07:06:03.727388 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.727390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.727522 (+ 132us) server_negotiation.cc:407] Connection header received
0808 07:06:03.727580 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.727581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.727591 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.727638 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:03.728093 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.728582 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.729418 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.729677 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.729851 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.732035 (+ 2184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:03.732038 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:03.732038 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:03.732045 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:03.733463 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:03.733806 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:03.733807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:03.733807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:03.733861 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:03.734033 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:03.734034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:03.734034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:03.734141 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:03.734232 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.734339 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.734416 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:06:03.735934 8966 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:06:03.736106 8966 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:06:03.737679 9176 tablet_service.cc:1467] Processing CreateTablet for tablet ea6f11d4396f415c8d379c154ef8f924 (DEFAULT_TABLE table=test-table [id=98def2c2b8b44e9ba06ea6ecd028750f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:03.737720 9375 tablet_service.cc:1467] Processing CreateTablet for tablet ea6f11d4396f415c8d379c154ef8f924 (DEFAULT_TABLE table=test-table [id=98def2c2b8b44e9ba06ea6ecd028750f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:03.737824 9375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6f11d4396f415c8d379c154ef8f924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.737824 9176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6f11d4396f415c8d379c154ef8f924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.739182 9724 tablet_bootstrap.cc:492] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a: Bootstrap starting.
I20260808 07:06:03.739243 9572 tablet_service.cc:1467] Processing CreateTablet for tablet ea6f11d4396f415c8d379c154ef8f924 (DEFAULT_TABLE table=test-table [id=98def2c2b8b44e9ba06ea6ecd028750f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:03.739373 9572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6f11d4396f415c8d379c154ef8f924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.739647 9724 tablet_bootstrap.cc:654] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.740334 9727 tablet_bootstrap.cc:492] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870: Bootstrap starting.
I20260808 07:06:03.740478 9726 tablet_bootstrap.cc:492] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342: Bootstrap starting.
I20260808 07:06:03.740754 9727 tablet_bootstrap.cc:654] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.740859 9726 tablet_bootstrap.cc:654] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.740871 9724 tablet_bootstrap.cc:492] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a: No bootstrap required, opened a new log
I20260808 07:06:03.740912 9724 ts_tablet_manager.cc:1397] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260808 07:06:03.741088 9724 raft_consensus.cc:348] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.741389 9724 raft_consensus.cc:374] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.741420 9724 raft_consensus.cc:729] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5cfcc5d11d421399e54ab3baefbf1a, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.741466 9724 consensus_queue.cc:260] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.741577 9724 ts_tablet_manager.cc:1428] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:03.741711 9726 tablet_bootstrap.cc:492] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342: No bootstrap required, opened a new log
I20260808 07:06:03.741758 9726 ts_tablet_manager.cc:1397] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 07:06:03.741849 9727 tablet_bootstrap.cc:492] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870: No bootstrap required, opened a new log
I20260808 07:06:03.741895 9727 ts_tablet_manager.cc:1397] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:06:03.741896 9726 raft_consensus.cc:348] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.741973 9726 raft_consensus.cc:374] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.741991 9726 raft_consensus.cc:729] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9bf8a30eb84406fa379c96555932342, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.742002 9727 raft_consensus.cc:348] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.742035 9726 consensus_queue.cc:260] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.742077 9727 raft_consensus.cc:374] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.742101 9727 raft_consensus.cc:729] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892713600d045668fcbcd227a65d870, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.742120 9726 ts_tablet_manager.cc:1428] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 07:06:03.742141 9727 consensus_queue.cc:260] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.742216 9727 ts_tablet_manager.cc:1428] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:03.764935 9733 raft_consensus.cc:482] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:06:03.765048 9733 raft_consensus.cc:504] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.765231 9733 leader_election.cc:288] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892713600d045668fcbcd227a65d870 (127.29.82.66:37513), e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025)
I20260808 07:06:03.765440 9399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6f11d4396f415c8d379c154ef8f924" candidate_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892713600d045668fcbcd227a65d870" is_pre_election: true
I20260808 07:06:03.765491 9614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6f11d4396f415c8d379c154ef8f924" candidate_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9bf8a30eb84406fa379c96555932342" is_pre_election: true
I20260808 07:06:03.765584 9614 raft_consensus.cc:2454] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d5cfcc5d11d421399e54ab3baefbf1a in term 0.
I20260808 07:06:03.765611 9399 raft_consensus.cc:2454] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d5cfcc5d11d421399e54ab3baefbf1a in term 0.
I20260808 07:06:03.765774 9098 leader_election.cc:302] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5cfcc5d11d421399e54ab3baefbf1a, 6892713600d045668fcbcd227a65d870; no voters:
I20260808 07:06:03.765915 9733 raft_consensus.cc:2781] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:06:03.765995 9733 raft_consensus.cc:482] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:06:03.766016 9733 raft_consensus.cc:3037] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.766999 9733 raft_consensus.cc:504] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.767143 9733 leader_election.cc:288] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [CANDIDATE]: Term 1 election: Requested vote from peers 6892713600d045668fcbcd227a65d870 (127.29.82.66:37513), e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025)
I20260808 07:06:03.767343 9399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6f11d4396f415c8d379c154ef8f924" candidate_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892713600d045668fcbcd227a65d870"
I20260808 07:06:03.767422 9399 raft_consensus.cc:3037] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.767397 9614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6f11d4396f415c8d379c154ef8f924" candidate_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9bf8a30eb84406fa379c96555932342"
I20260808 07:06:03.767496 9614 raft_consensus.cc:3037] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.768231 9614 raft_consensus.cc:2454] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5cfcc5d11d421399e54ab3baefbf1a in term 1.
I20260808 07:06:03.768239 9399 raft_consensus.cc:2454] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5cfcc5d11d421399e54ab3baefbf1a in term 1.
I20260808 07:06:03.768437 9098 leader_election.cc:302] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5cfcc5d11d421399e54ab3baefbf1a, 6892713600d045668fcbcd227a65d870; no voters:
I20260808 07:06:03.768541 9733 raft_consensus.cc:2781] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:03.768733 9733 raft_consensus.cc:686] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 LEADER]: Becoming Leader. State: Replica: 0d5cfcc5d11d421399e54ab3baefbf1a, State: Running, Role: LEADER
I20260808 07:06:03.768819 9733 consensus_queue.cc:237] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.769629 8967 catalog_manager.cc:5495] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d5cfcc5d11d421399e54ab3baefbf1a (127.29.82.65). New cstate: current_term: 1 leader_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } health_report { overall_health: UNKNOWN } } }
I20260808 07:06:03.778218 9723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.775671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49928 (local address 127.29.82.65:43967)
0808 07:06:03.775725 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.775727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.775754 (+ 27us) server_negotiation.cc:407] Connection header received
0808 07:06:03.775848 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.775849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.775874 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.775944 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:03.776068 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.776547 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.777401 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.777649 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.777710 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.777867 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:03.777994 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:03.778060 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.778108 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.778134 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:06:03.779273 9614 raft_consensus.cc:1261] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Refusing update from remote peer 0d5cfcc5d11d421399e54ab3baefbf1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:03.779337 9399 raft_consensus.cc:1261] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Refusing update from remote peer 0d5cfcc5d11d421399e54ab3baefbf1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:03.779633 9733 consensus_queue.cc:1035] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:03.779788 9818 consensus_queue.cc:1035] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:03.783174 8966 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:06:03.783267 8966 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:06:03.783859 8966 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a: Sending DeleteTablet for 3 replicas of tablet ea6f11d4396f415c8d379c154ef8f924
I20260808 07:06:03.784128 9176 tablet_service.cc:1514] Processing DeleteTablet for tablet ea6f11d4396f415c8d379c154ef8f924 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:03 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:49922
I20260808 07:06:03.784158 9375 tablet_service.cc:1514] Processing DeleteTablet for tablet ea6f11d4396f415c8d379c154ef8f924 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:03 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:36124
I20260808 07:06:03.784221 9759 tablet_replica.cc:330] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a: stopping tablet replica
I20260808 07:06:03.784247 9758 tablet_replica.cc:330] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870: stopping tablet replica
I20260808 07:06:03.784271 9759 raft_consensus.cc:2229] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:06:03.784292 9758 raft_consensus.cc:2229] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:06:03.784334 9758 raft_consensus.cc:2258] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:06:03.784336 9759 raft_consensus.cc:2258] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:06:03.784346 8966 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:06:03.784500 8966 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:06:03.784567 9572 tablet_service.cc:1514] Processing DeleteTablet for tablet ea6f11d4396f415c8d379c154ef8f924 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:03 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:51002
I20260808 07:06:03.784644 9760 tablet_replica.cc:330] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342: stopping tablet replica
I20260808 07:06:03.784685 9760 raft_consensus.cc:2229] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:06:03.784698 9759 ts_tablet_manager.cc:1905] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:06:03.784724 9760 raft_consensus.cc:2258] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:06:03.784970 9758 ts_tablet_manager.cc:1905] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:06:03.786301 9759 ts_tablet_manager.cc:1918] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:06:03.786358 9759 log.cc:1196] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-0/wal/wals/ea6f11d4396f415c8d379c154ef8f924
I20260808 07:06:03.786384 9760 ts_tablet_manager.cc:1905] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:06:03.786568 9759 ts_tablet_manager.cc:1939] T ea6f11d4396f415c8d379c154ef8f924 P 0d5cfcc5d11d421399e54ab3baefbf1a: Deleting consensus metadata
I20260808 07:06:03.786695 9758 ts_tablet_manager.cc:1918] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:06:03.786746 9758 log.cc:1196] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/ea6f11d4396f415c8d379c154ef8f924
I20260808 07:06:03.786929 9758 ts_tablet_manager.cc:1939] T ea6f11d4396f415c8d379c154ef8f924 P 6892713600d045668fcbcd227a65d870: Deleting consensus metadata
I20260808 07:06:03.787313 8947 catalog_manager.cc:4841] TS 6892713600d045668fcbcd227a65d870 (127.29.82.66:37513): tablet ea6f11d4396f415c8d379c154ef8f924 (table test-table [id=98def2c2b8b44e9ba06ea6ecd028750f]) successfully deleted
I20260808 07:06:03.787382 8947 catalog_manager.cc:4841] TS 0d5cfcc5d11d421399e54ab3baefbf1a (127.29.82.65:43967): tablet ea6f11d4396f415c8d379c154ef8f924 (table test-table [id=98def2c2b8b44e9ba06ea6ecd028750f]) successfully deleted
I20260808 07:06:03.787372 9176 tablet_service.cc:1467] Processing CreateTablet for tablet 1550e9ce35dd49ac8b364eb289b2bb72 (DEFAULT_TABLE table=test-table [id=5d3e4507fc61436dbec927ce1d62a91d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:03.787477 9176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1550e9ce35dd49ac8b364eb289b2bb72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.787508 9375 tablet_service.cc:1467] Processing CreateTablet for tablet 1550e9ce35dd49ac8b364eb289b2bb72 (DEFAULT_TABLE table=test-table [id=5d3e4507fc61436dbec927ce1d62a91d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:03.787600 9375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1550e9ce35dd49ac8b364eb289b2bb72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.787822 9760 ts_tablet_manager.cc:1918] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:06:03.787869 9760 log.cc:1196] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/ea6f11d4396f415c8d379c154ef8f924
I20260808 07:06:03.788051 9760 ts_tablet_manager.cc:1939] T ea6f11d4396f415c8d379c154ef8f924 P e9bf8a30eb84406fa379c96555932342: Deleting consensus metadata
I20260808 07:06:03.788781 9724 tablet_bootstrap.cc:492] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a: Bootstrap starting.
I20260808 07:06:03.789144 9724 tablet_bootstrap.cc:654] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.789247 9727 tablet_bootstrap.cc:492] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870: Bootstrap starting.
I20260808 07:06:03.789556 9727 tablet_bootstrap.cc:654] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.789714 9724 tablet_bootstrap.cc:492] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a: No bootstrap required, opened a new log
I20260808 07:06:03.789748 9724 ts_tablet_manager.cc:1397] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:03.789837 8947 catalog_manager.cc:4841] TS e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025): tablet ea6f11d4396f415c8d379c154ef8f924 (table test-table [id=98def2c2b8b44e9ba06ea6ecd028750f]) successfully deleted
I20260808 07:06:03.789884 9724 raft_consensus.cc:348] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.789958 9724 raft_consensus.cc:374] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.789976 9724 raft_consensus.cc:729] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5cfcc5d11d421399e54ab3baefbf1a, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.790022 9724 consensus_queue.cc:260] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.790117 9724 ts_tablet_manager.cc:1428] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:03.790324 9572 tablet_service.cc:1467] Processing CreateTablet for tablet 1550e9ce35dd49ac8b364eb289b2bb72 (DEFAULT_TABLE table=test-table [id=5d3e4507fc61436dbec927ce1d62a91d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:03.790429 9572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1550e9ce35dd49ac8b364eb289b2bb72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.790686 9727 tablet_bootstrap.cc:492] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870: No bootstrap required, opened a new log
I20260808 07:06:03.790728 9727 ts_tablet_manager.cc:1397] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 07:06:03.790843 9727 raft_consensus.cc:348] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.790900 9727 raft_consensus.cc:374] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.790920 9727 raft_consensus.cc:729] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892713600d045668fcbcd227a65d870, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.790967 9727 consensus_queue.cc:260] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.791055 9727 ts_tablet_manager.cc:1428] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:03.791464 9726 tablet_bootstrap.cc:492] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342: Bootstrap starting.
I20260808 07:06:03.791862 9726 tablet_bootstrap.cc:654] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.792438 9726 tablet_bootstrap.cc:492] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342: No bootstrap required, opened a new log
I20260808 07:06:03.792492 9726 ts_tablet_manager.cc:1397] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 07:06:03.792632 9726 raft_consensus.cc:348] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.792703 9726 raft_consensus.cc:374] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.792732 9726 raft_consensus.cc:729] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9bf8a30eb84406fa379c96555932342, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.792779 9726 consensus_queue.cc:260] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.792891 9726 ts_tablet_manager.cc:1428] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 07:06:03.800202 9826 raft_consensus.cc:482] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:06:03.800311 9826 raft_consensus.cc:504] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.800467 9826 leader_election.cc:288] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892713600d045668fcbcd227a65d870 (127.29.82.66:37513), e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025)
I20260808 07:06:03.800791 9614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1550e9ce35dd49ac8b364eb289b2bb72" candidate_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9bf8a30eb84406fa379c96555932342" is_pre_election: true
I20260808 07:06:03.800885 9614 raft_consensus.cc:2454] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d5cfcc5d11d421399e54ab3baefbf1a in term 0.
I20260808 07:06:03.800859 9399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1550e9ce35dd49ac8b364eb289b2bb72" candidate_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892713600d045668fcbcd227a65d870" is_pre_election: true
I20260808 07:06:03.800980 9399 raft_consensus.cc:2454] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d5cfcc5d11d421399e54ab3baefbf1a in term 0.
I20260808 07:06:03.801052 9098 leader_election.cc:302] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5cfcc5d11d421399e54ab3baefbf1a, e9bf8a30eb84406fa379c96555932342; no voters:
I20260808 07:06:03.801143 9826 raft_consensus.cc:2781] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:06:03.801205 9826 raft_consensus.cc:482] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:06:03.801234 9826 raft_consensus.cc:3037] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.802004 9826 raft_consensus.cc:504] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.802134 9826 leader_election.cc:288] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [CANDIDATE]: Term 1 election: Requested vote from peers 6892713600d045668fcbcd227a65d870 (127.29.82.66:37513), e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025)
I20260808 07:06:03.802299 9399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1550e9ce35dd49ac8b364eb289b2bb72" candidate_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892713600d045668fcbcd227a65d870"
I20260808 07:06:03.802327 9614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1550e9ce35dd49ac8b364eb289b2bb72" candidate_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9bf8a30eb84406fa379c96555932342"
I20260808 07:06:03.802378 9399 raft_consensus.cc:3037] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.802392 9614 raft_consensus.cc:3037] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.803035 9614 raft_consensus.cc:2454] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5cfcc5d11d421399e54ab3baefbf1a in term 1.
I20260808 07:06:03.803170 9399 raft_consensus.cc:2454] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5cfcc5d11d421399e54ab3baefbf1a in term 1.
I20260808 07:06:03.803169 9098 leader_election.cc:302] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5cfcc5d11d421399e54ab3baefbf1a, e9bf8a30eb84406fa379c96555932342; no voters:
I20260808 07:06:03.803258 9826 raft_consensus.cc:2781] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:03.803335 9826 raft_consensus.cc:686] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 LEADER]: Becoming Leader. State: Replica: 0d5cfcc5d11d421399e54ab3baefbf1a, State: Running, Role: LEADER
I20260808 07:06:03.803380 9826 consensus_queue.cc:237] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } }
I20260808 07:06:03.803942 8966 catalog_manager.cc:5495] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d5cfcc5d11d421399e54ab3baefbf1a (127.29.82.65). New cstate: current_term: 1 leader_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5cfcc5d11d421399e54ab3baefbf1a" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 } health_report { overall_health: UNKNOWN } } }
I20260808 07:06:03.817075 9837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.814219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:37513 (local address 127.29.82.65:37917)
0808 07:06:03.814400 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.814410 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:03.814498 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:03.814616 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:03.814616 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:03.814618 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:06:03.814677 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.814678 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.815551 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.815553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.816190 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.816192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.816645 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.816646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.816692 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.816706 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:06:03.816882 (+ 176us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:06:03.816885 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:06:03.816946 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:06:03.816991 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":81,"threads_started":1}
I20260808 07:06:03.817058 9717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.814281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:37917 (local address 127.29.82.66:37513)
0808 07:06:03.814331 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.814333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.814500 (+ 167us) server_negotiation.cc:407] Connection header received
0808 07:06:03.814550 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.814551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.814562 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.814613 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:03.814713 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.815467 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.816263 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.816568 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.816635 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.816773 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:03.816807 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:03.816853 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.816956 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.816974 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:06:03.819133 9399 raft_consensus.cc:1261] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Refusing update from remote peer 0d5cfcc5d11d421399e54ab3baefbf1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:03.819135 9614 raft_consensus.cc:1261] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Refusing update from remote peer 0d5cfcc5d11d421399e54ab3baefbf1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:03.819341 9818 consensus_queue.cc:1035] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892713600d045668fcbcd227a65d870" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 37513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:03.819456 9826 consensus_queue.cc:1035] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9bf8a30eb84406fa379c96555932342" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:03.826189 9723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.823909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:41127 (local address 127.29.82.65:43967)
0808 07:06:03.823966 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.823968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.823976 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:06:03.823995 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.823996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.824006 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.824053 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:03.824172 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.824708 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.825585 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.825782 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.825836 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.825962 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:03.826003 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:03.826043 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.826098 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.826115 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:06:03.826223 9790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.823717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:43967 (local address 127.29.82.66:41127)
0808 07:06:03.823804 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.823816 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:03.823851 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:03.824073 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:03.824075 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:03.824077 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:06:03.824122 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.824124 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.824767 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.824768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.825511 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:03.825514 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.825838 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.825840 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:03.825894 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.825901 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:06:03.826043 (+ 142us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:06:03.826046 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:06:03.826085 (+ 39us) client_negotiation.cc:240] Negotiation successful
0808 07:06:03.826138 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 07:06:03.832885 8967 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:06:03.832996 8967 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:06:03.833649 8967 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57fbb851d6364184b0f6f40c09c4c64a: Sending DeleteTablet for 3 replicas of tablet 1550e9ce35dd49ac8b364eb289b2bb72
I20260808 07:06:03.833918 9176 tablet_service.cc:1514] Processing DeleteTablet for tablet 1550e9ce35dd49ac8b364eb289b2bb72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:03 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:49922
I20260808 07:06:03.833935 9572 tablet_service.cc:1514] Processing DeleteTablet for tablet 1550e9ce35dd49ac8b364eb289b2bb72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:03 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:51002
I20260808 07:06:03.833935 9375 tablet_service.cc:1514] Processing DeleteTablet for tablet 1550e9ce35dd49ac8b364eb289b2bb72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:03 UTC) from {username='oryx', principal='oryx/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:36124
I20260808 07:06:03.834021 9759 tablet_replica.cc:330] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a: stopping tablet replica
I20260808 07:06:03.834028 9758 tablet_replica.cc:330] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870: stopping tablet replica
I20260808 07:06:03.834029 9760 tablet_replica.cc:330] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342: stopping tablet replica
I20260808 07:06:03.834071 9760 raft_consensus.cc:2229] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:06:03.834074 9758 raft_consensus.cc:2229] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:06:03.834064 9759 raft_consensus.cc:2229] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:06:03.834108 9758 raft_consensus.cc:2258] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:06:03.834108 9760 raft_consensus.cc:2258] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:06:03.834134 9759 raft_consensus.cc:2258] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:06:03.834502 9760 ts_tablet_manager.cc:1905] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:06:03.834496 9759 ts_tablet_manager.cc:1905] T 1550e9ce35dd49ac8b364eb289b2bb72 P 0d5cfcc5d11d421399e54ab3baefbf1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:06:03.834600 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 9078
I20260808 07:06:03.842419 9760 ts_tablet_manager.cc:1918] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:06:03.842506 9760 log.cc:1196] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/1550e9ce35dd49ac8b364eb289b2bb72
I20260808 07:06:03.842728 9760 ts_tablet_manager.cc:1939] T 1550e9ce35dd49ac8b364eb289b2bb72 P e9bf8a30eb84406fa379c96555932342: Deleting consensus metadata
I20260808 07:06:03.843643 8947 catalog_manager.cc:4841] TS e9bf8a30eb84406fa379c96555932342 (127.29.82.67:34025): tablet 1550e9ce35dd49ac8b364eb289b2bb72 (table test-table [id=5d3e4507fc61436dbec927ce1d62a91d]) successfully deleted
I20260808 07:06:03.845528 9758 ts_tablet_manager.cc:1905] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:06:03.846817 9758 ts_tablet_manager.cc:1918] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:06:03.846877 9758 log.cc:1196] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/1550e9ce35dd49ac8b364eb289b2bb72
I20260808 07:06:03.847050 9758 ts_tablet_manager.cc:1939] T 1550e9ce35dd49ac8b364eb289b2bb72 P 6892713600d045668fcbcd227a65d870: Deleting consensus metadata
I20260808 07:06:03.847424 8947 catalog_manager.cc:4841] TS 6892713600d045668fcbcd227a65d870 (127.29.82.66:37513): tablet 1550e9ce35dd49ac8b364eb289b2bb72 (table test-table [id=5d3e4507fc61436dbec927ce1d62a91d]) successfully deleted
W20260808 07:06:03.849776 8947 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:43967 (error 108)
I20260808 07:06:03.850045 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 9276
I20260808 07:06:03.857784 9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.850118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:43967 (local address 127.0.0.1:49940)
0808 07:06:03.857640 (+ 7522us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:03.857724 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:43967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7492,"thread_start_us":43,"threads_started":1}
W20260808 07:06:03.857921 8947 catalog_manager.cc:4584] TS 0d5cfcc5d11d421399e54ab3baefbf1a (127.29.82.65:43967): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1550e9ce35dd49ac8b364eb289b2bb72: Network error: Client connection negotiation failed: client connection to 127.29.82.65:43967: connect: Connection refused (error 111)
I20260808 07:06:03.868722 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 9483
I20260808 07:06:03.879305 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 8923
2026-08-08T07:06:03Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2698 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:03 dist-test-slave-rmhg krb5kdc[9846](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:03 dist-test-slave-rmhg krb5kdc[9846](info): set up 2 sockets
Aug 08 07:06:03 dist-test-slave-rmhg krb5kdc[9846](info): commencing operation
krb5kdc: starting...
W20260808 07:06:05.011895 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:06:05 dist-test-slave-rmhg krb5kdc[9846](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:06:05.135641 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:35999
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:38795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:35999
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:05.219137 9866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:05.219379 9866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:05.219410 9866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:05.220633 9866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:05.220695 9866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:05.220716 9866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:05.220732 9866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:05.220749 9866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:05.222363 9866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:38795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:35999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:35999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:05.222651 9866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:05.222882 9866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:05.227869 9872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:05.227875 9873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:05.228092 9866 server_base.cc:1034] running on GCE node
W20260808 07:06:05.227939 9875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:05.228592 9866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:05.228888 9866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:05.230034 9866 hybrid_clock.cc:648] HybridClock initialized: now 1786172765230011 us; error 40 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T07:06:05Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1349 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:05 dist-test-slave-rmhg krb5kdc[9882](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:05 dist-test-slave-rmhg krb5kdc[9882](info): set up 2 sockets
Aug 08 07:06:05 dist-test-slave-rmhg krb5kdc[9882](info): commencing operation
krb5kdc: starting...
W20260808 07:06:06.369285 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:06:06 dist-test-slave-rmhg krb5kdc[9882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172766, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:06:06.496299 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:46447
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:46447
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:06.580709 9902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:06.580940 9902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:06.580971 9902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:06.582178 9902 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:06.582226 9902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:06.582243 9902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:06.582259 9902 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:06.582274 9902 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:06.583778 9902 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:46447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:46447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:06.584038 9902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:06.584256 9902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:06.589313 9917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:06.589385 9912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:06.589327 9911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:06.589520 9902 server_base.cc:1034] running on GCE node
I20260808 07:06:06.589776 9902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:06.590081 9902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:06.591228 9902 hybrid_clock.cc:648] HybridClock initialized: now 1786172766591209 us; error 36 us; skew 500 ppm
Aug 08 07:06:06 dist-test-slave-rmhg krb5kdc[9882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172766, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:06.597219 9902 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:06:06.597750 9902 webserver.cc:460] Webserver started at http://127.29.82.126:45219/ using document root <none> and password file <none>
I20260808 07:06:06.597975 9902 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:06.598022 9902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:06.598174 9902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:06.599303 9902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "6b83c4887e604f3e8b88eedcf70cd6d6"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-rmhg"
server_key: "4a733167d49bf5437ab63ffdc6f2823e"
server_key_iv: "1bd5572ae11fce31ba366c423027c1b4"
server_key_version: "encryptionkey@0"
I20260808 07:06:06.599664 9902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "6b83c4887e604f3e8b88eedcf70cd6d6"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-rmhg"
server_key: "4a733167d49bf5437ab63ffdc6f2823e"
server_key_iv: "1bd5572ae11fce31ba366c423027c1b4"
server_key_version: "encryptionkey@0"
I20260808 07:06:06.601106 9902 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:06:06.602006 9928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:06.602176 9902 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:06.602269 9902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "6b83c4887e604f3e8b88eedcf70cd6d6"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-rmhg"
server_key: "4a733167d49bf5437ab63ffdc6f2823e"
server_key_iv: "1bd5572ae11fce31ba366c423027c1b4"
server_key_version: "encryptionkey@0"
I20260808 07:06:06.602344 9902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:06.616509 9902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:06.618705 9902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:06.618832 9902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:06.622953 9902 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:46447
I20260808 07:06:06.622987 10002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:46447 every 8 connection(s)
I20260808 07:06:06.623351 9902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:06.624269 10003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:06.626821 10003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6: Bootstrap starting.
I20260808 07:06:06.627403 10003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:06.627650 10003 log.cc:824] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:06.628479 10003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6: No bootstrap required, opened a new log
I20260808 07:06:06.630182 10003 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46447 } }
I20260808 07:06:06.630336 10003 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:06.630360 10003 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b83c4887e604f3e8b88eedcf70cd6d6, State: Initialized, Role: FOLLOWER
I20260808 07:06:06.630474 10003 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46447 } }
I20260808 07:06:06.630532 10003 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:06.630563 10003 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:06.630604 10003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:06.631155 10003 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46447 } }
I20260808 07:06:06.631259 10003 leader_election.cc:302] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b83c4887e604f3e8b88eedcf70cd6d6; no voters:
I20260808 07:06:06.631433 10003 leader_election.cc:288] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:06:06.631518 10007 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:06.631711 10003 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:06.631740 10007 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 1 LEADER]: Becoming Leader. State: Replica: 6b83c4887e604f3e8b88eedcf70cd6d6, State: Running, Role: LEADER
I20260808 07:06:06.631860 10007 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46447 } }
I20260808 07:06:06.632422 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 9902
I20260808 07:06:06.632485 10008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46447 } } }
I20260808 07:06:06.632547 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:06:06.632560 10008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:06.632751 30025 external_mini_cluster.cc:1428] Setting key 60591b4dfeb1df69509c15d7ecd8a814
I20260808 07:06:06.632910 10012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b83c4887e604f3e8b88eedcf70cd6d6. Latest consensus state: current_term: 1 leader_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46447 } } }
I20260808 07:06:06.632972 10012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:06.633306 10020 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:06.633955 10020 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:06.635629 10020 catalog_manager.cc:1347] Generated new cluster ID: f576b84499574cc5a3f37f29d0c45709
I20260808 07:06:06.635685 10020 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:06:06 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172766, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:06:06.643168 10038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:06.633410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38050 (local address 127.29.82.126:46447)
0808 07:06:06.633615 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:06.633626 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:06.633662 (+ 36us) server_negotiation.cc:407] Connection header received
0808 07:06:06.633780 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:06.633785 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:06.633833 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:06.633957 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:06.634590 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:06.635924 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:06.636672 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:06.637101 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:06.637251 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:06.639474 (+ 2223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:06.639479 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:06.639479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:06.639493 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:06.641650 (+ 2157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:06.641997 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:06.642001 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:06.642001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:06.642104 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:06.642295 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:06.642296 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:06.642297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:06.642558 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:06.642721 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:06.642807 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 07:06:06.642954 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":72,"threads_started":1}
I20260808 07:06:06.645803 10020 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:06.646322 10020 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:06.649456 10020 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6: Generated new TSK 0
I20260808 07:06:06.649633 10020 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:06:06.683353 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46447
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:06.768537 10047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:06.768778 10047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:06.768805 10047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:06.770035 10047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:06.770087 10047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:06.770114 10047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:06:06.771608 10047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:06.771867 10047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:06.772229 10047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:06.777809 10055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:06.777774 10054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:06.777946 10047 server_base.cc:1034] running on GCE node
W20260808 07:06:06.777783 10057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:06.778286 10047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:06.778577 10047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:06.779752 10047 hybrid_clock.cc:648] HybridClock initialized: now 1786172766779739 us; error 31 us; skew 500 ppm
Aug 08 07:06:06 dist-test-slave-rmhg krb5kdc[9882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172766, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:06.782519 10047 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:06:06.783023 10047 webserver.cc:460] Webserver started at http://127.29.82.65:44079/ using document root <none> and password file <none>
I20260808 07:06:06.783237 10047 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:06.783283 10047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:06.783396 10047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:06.784492 10047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "16d15224a7dc4a79a8d921f89f1bf99b"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-rmhg"
server_key: "012676ff00fb38ac784f2718db53ca3b"
server_key_iv: "b200cb3425243b57d25ac74d3effbb9e"
server_key_version: "encryptionkey@0"
I20260808 07:06:06.784828 10047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "16d15224a7dc4a79a8d921f89f1bf99b"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-rmhg"
server_key: "012676ff00fb38ac784f2718db53ca3b"
server_key_iv: "b200cb3425243b57d25ac74d3effbb9e"
server_key_version: "encryptionkey@0"
I20260808 07:06:06.786245 10047 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:06:06.787111 10069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:06.787309 10047 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:06.787410 10047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "16d15224a7dc4a79a8d921f89f1bf99b"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-rmhg"
server_key: "012676ff00fb38ac784f2718db53ca3b"
server_key_iv: "b200cb3425243b57d25ac74d3effbb9e"
server_key_version: "encryptionkey@0"
I20260808 07:06:06.787484 10047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:06.796617 10047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:06.798779 10047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:06.798905 10047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:06.799165 10047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:06.799487 10047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:06.799526 10047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:06.799551 10047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:06.799576 10047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:06.805397 10047 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:33655
I20260808 07:06:06.805459 10237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:33655 every 8 connection(s)
I20260808 07:06:06.805792 10047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:06:06.809329 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 10047
I20260808 07:06:06.809432 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:06:06.809615 30025 external_mini_cluster.cc:1428] Setting key 2b0c5cd52ad1128652650d32f179e011
Aug 08 07:06:06 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172766, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:06:06.815596 10038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:06.806509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:43321 (local address 127.29.82.126:46447)
0808 07:06:06.806561 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:06.806563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:06.806781 (+ 218us) server_negotiation.cc:407] Connection header received
0808 07:06:06.807295 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:06.807296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:06.807311 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:06.807361 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:06.808392 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:06.808913 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:06.810113 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:06.810373 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:06.810443 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:06.812721 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:06.812723 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:06.812723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:06.812732 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:06.814109 (+ 1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:06.814628 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:06.814628 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:06.814629 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:06.814694 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:06.814970 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:06.814971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:06.814971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:06.815084 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:06.815136 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:06.815457 (+ 321us) server_negotiation.cc:299] Negotiation successful
0808 07:06:06.815527 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:06:06.815886 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:06.806494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:43321)
0808 07:06:06.806649 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:06.806689 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:06.807194 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:06.807426 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:06.807430 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:06.808040 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:06.808300 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:06.808306 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:06.808988 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:06.808988 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:06.810044 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:06.810047 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:06.810456 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:06.810457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:06.810569 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:06.811081 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:06.811090 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:06.812622 (+ 1532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:06.814197 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:06.814205 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:06.814208 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:06.814555 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:06.814751 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:06.814752 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:06.814752 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:06.814905 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:06.815143 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:06.815149 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:06.815326 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 07:06:06.815444 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 07:06:06.815638 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260808 07:06:06.816452 10238 heartbeater.cc:347] Connected to a master server at 127.29.82.126:46447
I20260808 07:06:06.816572 10238 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:06.816783 10238 heartbeater.cc:511] Master 127.29.82.126:46447 requested a full tablet report, sending...
I20260808 07:06:06.817381 9953 ts_manager.cc:194] Registered new tserver with Master: 16d15224a7dc4a79a8d921f89f1bf99b (127.29.82.65:33655)
I20260808 07:06:06.817988 9953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:43321
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:06:06.836583 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46447
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:06.921438 10244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:06.921648 10244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:06.921671 10244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:06.922852 10244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:06.922899 10244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:06.922928 10244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:06:06.924432 10244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:06.924670 10244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:06.924896 10244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:06.929946 10251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:06.929913 10253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:06.929919 10250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:06.930266 10244 server_base.cc:1034] running on GCE node
I20260808 07:06:06.930465 10244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:06.930687 10244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:06.931829 10244 hybrid_clock.cc:648] HybridClock initialized: now 1786172766931814 us; error 27 us; skew 500 ppm
Aug 08 07:06:06 dist-test-slave-rmhg krb5kdc[9882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172766, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:06.934352 10244 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:06:06.934787 10244 webserver.cc:460] Webserver started at http://127.29.82.66:34783/ using document root <none> and password file <none>
I20260808 07:06:06.935021 10244 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:06.935072 10244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:06.935212 10244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:06.936308 10244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "9b1a734b96434a4695ceaa8252def835"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-rmhg"
server_key: "99502ddabf8c4fb4172a5759bcd1ef23"
server_key_iv: "47664ff873d502a527185f3faaee89c1"
server_key_version: "encryptionkey@0"
I20260808 07:06:06.936658 10244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "9b1a734b96434a4695ceaa8252def835"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-rmhg"
server_key: "99502ddabf8c4fb4172a5759bcd1ef23"
server_key_iv: "47664ff873d502a527185f3faaee89c1"
server_key_version: "encryptionkey@0"
I20260808 07:06:06.938030 10244 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:06:06.938724 10261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:06.938885 10244 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:06:06.938977 10244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "9b1a734b96434a4695ceaa8252def835"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-rmhg"
server_key: "99502ddabf8c4fb4172a5759bcd1ef23"
server_key_iv: "47664ff873d502a527185f3faaee89c1"
server_key_version: "encryptionkey@0"
I20260808 07:06:06.939036 10244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:06.980459 10244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:06.982637 10244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:06.982779 10244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:06.982963 10244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:06.983289 10244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:06.983326 10244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:06.983356 10244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:06.983373 10244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:06.989064 10244 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:32769
I20260808 07:06:06.989111 10424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:32769 every 8 connection(s)
I20260808 07:06:06.989470 10244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:06:06.992779 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 10244
I20260808 07:06:06.992903 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:06:06.993103 30025 external_mini_cluster.cc:1428] Setting key b37a07f095a6659e3d007d7396fbc509
Aug 08 07:06:06 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172766, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:06:06.999481 10038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:06.990196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:46093 (local address 127.29.82.126:46447)
0808 07:06:06.990252 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:06.990254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:06.990480 (+ 226us) server_negotiation.cc:407] Connection header received
0808 07:06:06.991020 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:06.991022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:06.991033 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:06.991074 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:06.992028 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:06.992533 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:06.993784 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:06.994021 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:06.994073 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:06.996586 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:06.996587 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:06.996588 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:06.996597 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:06.998044 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:06.998482 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:06.998484 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:06.998484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:06.998554 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:06.998824 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:06.998825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:06.998825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:06.998973 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:06.999043 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:06.999290 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 07:06:06.999379 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:06:06.999558 10429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:06.990178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:46093)
0808 07:06:06.990345 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:06.990382 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:06.990912 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:06.991160 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:06.991164 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:06.991745 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:06.991953 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:06.991958 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:06.992620 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:06.992621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:06.993713 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:06.993716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:06.994102 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:06.994103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:06.994254 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:06.994790 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:06.994801 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:06.996484 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:06.998140 (+ 1656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:06.998147 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:06.998149 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:06.998403 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:06.998629 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:06.998630 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:06.998631 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:06.998763 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:06.999031 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:06.999034 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:06.999167 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 07:06:06.999247 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 07:06:06.999377 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260808 07:06:07.000001 10425 heartbeater.cc:347] Connected to a master server at 127.29.82.126:46447
I20260808 07:06:07.000130 10425 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:07.000355 10425 heartbeater.cc:511] Master 127.29.82.126:46447 requested a full tablet report, sending...
I20260808 07:06:07.000818 9953 ts_manager.cc:194] Registered new tserver with Master: 9b1a734b96434a4695ceaa8252def835 (127.29.82.66:32769)
I20260808 07:06:07.001232 9953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:46093
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:06:07.020452 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46447
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:07.104710 10433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:07.105005 10433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:07.105029 10433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:07.106281 10433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:07.106328 10433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:07.106355 10433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:06:07.107839 10433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:07.108080 10433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:07.108321 10433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:07.113483 10441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:07.113517 10440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:07.113494 10445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:07.113726 10433 server_base.cc:1034] running on GCE node
I20260808 07:06:07.113916 10433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:07.114151 10433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:07.115301 10433 hybrid_clock.cc:648] HybridClock initialized: now 1786172767115290 us; error 38 us; skew 500 ppm
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172767, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:07.117769 10433 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:06:07.118234 10433 webserver.cc:460] Webserver started at http://127.29.82.67:39067/ using document root <none> and password file <none>
I20260808 07:06:07.118424 10433 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:07.118465 10433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:07.118556 10433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:07.119580 10433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "b2c3a0b222344a6f884959faa8109ad3"
format_stamp: "Formatted at 2026-08-08 07:06:07 on dist-test-slave-rmhg"
server_key: "2bb308328b4d1f1b37eba1a5e5ace4ed"
server_key_iv: "805420bccc930731094747c7ec46d454"
server_key_version: "encryptionkey@0"
I20260808 07:06:07.119946 10433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "b2c3a0b222344a6f884959faa8109ad3"
format_stamp: "Formatted at 2026-08-08 07:06:07 on dist-test-slave-rmhg"
server_key: "2bb308328b4d1f1b37eba1a5e5ace4ed"
server_key_iv: "805420bccc930731094747c7ec46d454"
server_key_version: "encryptionkey@0"
I20260808 07:06:07.121243 10433 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:06:07.121951 10452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:07.122120 10433 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:07.122207 10433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "b2c3a0b222344a6f884959faa8109ad3"
format_stamp: "Formatted at 2026-08-08 07:06:07 on dist-test-slave-rmhg"
server_key: "2bb308328b4d1f1b37eba1a5e5ace4ed"
server_key_iv: "805420bccc930731094747c7ec46d454"
server_key_version: "encryptionkey@0"
I20260808 07:06:07.122262 10433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:07.136144 10433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:07.138100 10433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:07.138218 10433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:07.138419 10433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:07.138731 10433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:07.138763 10433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:07.138785 10433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:07.138803 10433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:07.144366 10433 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:41061
I20260808 07:06:07.144410 10637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:41061 every 8 connection(s)
I20260808 07:06:07.144742 10433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:06:07.146214 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 10433
I20260808 07:06:07.146320 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:06:07.146502 30025 external_mini_cluster.cc:1428] Setting key 01992218a16735311dc18b8fcf86cec7
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172767, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:06:07.153406 10038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:07.145466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:42647 (local address 127.29.82.126:46447)
0808 07:06:07.145530 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:07.145532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:07.145724 (+ 192us) server_negotiation.cc:407] Connection header received
0808 07:06:07.146240 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:07.146242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:07.146255 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:07.146319 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:07.147462 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.147961 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.148905 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.149078 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.149122 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.151153 (+ 2031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:07.151154 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:07.151155 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:07.151163 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:07.152305 (+ 1142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:07.152667 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:07.152667 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:07.152668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:07.152714 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:07.152892 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:07.152893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:07.152893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:07.152993 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:07.153038 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:07.153276 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 07:06:07.153338 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:06:07.153595 10640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:07.145437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:42647)
0808 07:06:07.145602 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:07.145640 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:07.146153 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:07.146422 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:07.146428 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:07.147142 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:07.147390 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.147397 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.148032 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.148033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.148843 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.148846 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.149132 (+ 286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.149132 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.149283 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.149747 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:07.149756 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:07.151071 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:07.152372 (+ 1301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:07.152379 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:07.152381 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:07.152599 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:07.152759 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:07.152759 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:07.152759 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:07.152849 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:07.153036 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:07.153039 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:07.153172 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 07:06:07.153260 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 07:06:07.153383 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":85,"threads_started":1}
I20260808 07:06:07.154031 10638 heartbeater.cc:347] Connected to a master server at 127.29.82.126:46447
I20260808 07:06:07.154121 10638 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:07.154278 10638 heartbeater.cc:511] Master 127.29.82.126:46447 requested a full tablet report, sending...
I20260808 07:06:07.154649 9953 ts_manager.cc:194] Registered new tserver with Master: b2c3a0b222344a6f884959faa8109ad3 (127.29.82.67:41061)
I20260808 07:06:07.154990 9953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:42647
I20260808 07:06:07.158169 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.65.keytab.
Entry for principal oryx/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.65.keytab.
WARNING: no policy specified for oryx/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.66.keytab.
Entry for principal oryx/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.66.keytab.
WARNING: no policy specified for oryx/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.67.keytab.
Entry for principal oryx/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.67.keytab.
I20260808 07:06:07.227757 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 10047
I20260808 07:06:07.243888 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 10244
I20260808 07:06:07.255504 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 10433
I20260808 07:06:07.272913 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 9902
I20260808 07:06:07.280124 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:46447
--webserver_interface=127.29.82.126
--webserver_port=45219
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:46447
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:07.363840 10650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:07.364073 10650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:07.364105 10650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:07.365409 10650 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:07.365461 10650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:07.365482 10650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:07.365499 10650 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:07.365513 10650 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:07.367024 10650 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:46447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:46447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=45219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:07.367277 10650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:07.367502 10650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:07.372308 10661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:07.372771 10659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:07.372771 10663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:07.373009 10650 server_base.cc:1034] running on GCE node
I20260808 07:06:07.373282 10650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:07.373593 10650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:07.374724 10650 hybrid_clock.cc:648] HybridClock initialized: now 1786172767374714 us; error 28 us; skew 500 ppm
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172767, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:07.377265 10650 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:06:07.377758 10650 webserver.cc:460] Webserver started at http://127.29.82.126:45219/ using document root <none> and password file <none>
I20260808 07:06:07.377993 10650 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:07.378062 10650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:07.379447 10650 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:07.380122 10673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:07.380287 10650 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:07.380378 10650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "6b83c4887e604f3e8b88eedcf70cd6d6"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-rmhg"
server_key: "4a733167d49bf5437ab63ffdc6f2823e"
server_key_iv: "1bd5572ae11fce31ba366c423027c1b4"
server_key_version: "encryptionkey@0"
I20260808 07:06:07.380743 10650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:07.388818 10650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:07.390692 10650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:07.390832 10650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:07.394822 10650 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:46447
I20260808 07:06:07.394855 10745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:46447 every 8 connection(s)
I20260808 07:06:07.395236 10650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:07.396713 10746 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:06:07.397394 10746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6: Bootstrap starting.
I20260808 07:06:07.405424 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 10650
I20260808 07:06:07.405588 10746 log.cc:824] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:07.405752 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:33655
--local_ip_for_outbound_sockets=127.29.82.65
--tserver_master_addrs=127.29.82.126:46447
--webserver_port=44079
--webserver_interface=127.29.82.65
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.29.82.65
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:06:07.407437 10746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:06:07.407714 10746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6: Bootstrap complete.
I20260808 07:06:07.409992 10746 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46447 } }
I20260808 07:06:07.410238 10746 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b83c4887e604f3e8b88eedcf70cd6d6, State: Initialized, Role: FOLLOWER
I20260808 07:06:07.410411 10746 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46447 } }
I20260808 07:06:07.410491 10746 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:07.410544 10746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:07.410593 10746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:06:07.411610 10746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46447 } }
I20260808 07:06:07.411715 10746 leader_election.cc:302] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b83c4887e604f3e8b88eedcf70cd6d6; no voters:
I20260808 07:06:07.411887 10746 leader_election.cc:288] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 07:06:07.411978 10750 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:06:07.412173 10750 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [term 2 LEADER]: Becoming Leader. State: Replica: 6b83c4887e604f3e8b88eedcf70cd6d6, State: Running, Role: LEADER
I20260808 07:06:07.412207 10746 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:07.412282 10750 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46447 } }
I20260808 07:06:07.412624 10751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46447 } } }
I20260808 07:06:07.412667 10752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b83c4887e604f3e8b88eedcf70cd6d6. Latest consensus state: current_term: 2 leader_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b83c4887e604f3e8b88eedcf70cd6d6" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46447 } } }
I20260808 07:06:07.412721 10751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:07.412735 10752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:07.413362 10756 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:07.413928 10756 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:07.414084 10756 catalog_manager.cc:1259] Loaded cluster ID: f576b84499574cc5a3f37f29d0c45709
I20260808 07:06:07.414137 10756 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:06:07.415167 10756 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:07.415337 10756 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6b83c4887e604f3e8b88eedcf70cd6d6: Loaded TSK: 0
I20260808 07:06:07.415550 10756 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:06:07.502473 10749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:07.502686 10749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:07.502707 10749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:07.503896 10749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:07.503943 10749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:07.503968 10749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:06:07.505476 10749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.65.keytab
--principal=oryx/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:33655
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=44079
--tserver_master_addrs=127.29.82.126:46447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:07.505702 10749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:07.505924 10749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:07.510973 10786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:07.511071 10791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:07.511273 10788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:07.511713 10749 server_base.cc:1034] running on GCE node
I20260808 07:06:07.511927 10749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:07.512198 10749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:07.513372 10749 hybrid_clock.cc:648] HybridClock initialized: now 1786172767513354 us; error 35 us; skew 500 ppm
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172767, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:07.516366 10749 init.cc:377] Logged in from keytab as oryx/127.29.82.65@KRBTEST.COM (short username oryx)
I20260808 07:06:07.516934 10749 webserver.cc:460] Webserver started at http://127.29.82.65:44079/ using document root <none> and password file <none>
I20260808 07:06:07.517194 10749 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:07.517273 10749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:07.518747 10749 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:07.519377 10800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:07.519533 10749 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:07.519629 10749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "16d15224a7dc4a79a8d921f89f1bf99b"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-rmhg"
server_key: "012676ff00fb38ac784f2718db53ca3b"
server_key_iv: "b200cb3425243b57d25ac74d3effbb9e"
server_key_version: "encryptionkey@0"
I20260808 07:06:07.519981 10749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:07.538123 10749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:07.540586 10749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:07.540743 10749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:07.540982 10749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:07.541364 10749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:07.541407 10749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:07.541437 10749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:07.541471 10749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:07.548982 10749 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:33655
I20260808 07:06:07.549017 10954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:33655 every 8 connection(s)
I20260808 07:06:07.549515 10749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:06:07.551878 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 10749
I20260808 07:06:07.552242 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:32769
--local_ip_for_outbound_sockets=127.29.82.66
--tserver_master_addrs=127.29.82.126:46447
--webserver_port=34783
--webserver_interface=127.29.82.66
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.29.82.66
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:07.559917 10958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:07.550372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:40461)
0808 07:06:07.550575 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:07.550626 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:07.551133 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:07.551599 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:07.551604 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:07.552450 (+ 846us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:07.552733 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.552741 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.554433 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.554435 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.555501 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.555505 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.556318 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.556320 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.556471 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.557068 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:07.557080 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:07.559695 (+ 2615us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":95,"threads_started":1}
W20260808 07:06:07.559998 10960 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:07.550466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:40461 (local address 127.29.82.126:46447)
0808 07:06:07.550694 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:07.550702 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:07.550737 (+ 35us) server_negotiation.cc:407] Connection header received
0808 07:06:07.551357 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:07.551362 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:07.551408 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:07.551549 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:07.552887 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.554312 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.555603 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.556208 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.556321 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.559845 (+ 3524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:40461: BlockingRecv error: recv got EOF from 127.29.82.65:40461 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":109,"threads_started":1}
W20260808 07:06:07.560256 10956 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:46447 (0 consecutive failures): Not authorized: Failed to ping master at 127.29.82.126:46447: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:07.565287 10958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:07.560519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:38159)
0808 07:06:07.560569 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:07.560580 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:07.560620 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:07.560738 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:07.560739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:07.560864 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:07.560908 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.560910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.561794 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.561795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.562317 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.562319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.562660 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.562661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.562728 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.563146 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:07.563152 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:07.565231 (+ 2079us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 07:06:07.565469 10960 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:07.560578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:38159 (local address 127.29.82.126:46447)
0808 07:06:07.560635 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:07.560637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:07.560645 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:06:07.560669 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:07.560670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:07.560683 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:07.560731 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:07.560995 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.561706 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.562397 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.562601 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.562656 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.565321 (+ 2665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:38159: BlockingRecv error: recv got EOF from 127.29.82.65:38159 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:07.569674 10958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:07.565601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:52587)
0808 07:06:07.565649 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:07.565660 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:07.565703 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:07.565821 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:07.565822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:07.565945 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:07.565980 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.565982 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.566594 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.566595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.567084 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.567085 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.567392 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.567393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.567465 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.567889 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:07.567894 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:07.569604 (+ 1710us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 07:06:07.569758 10960 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:07.565645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:52587 (local address 127.29.82.126:46447)
0808 07:06:07.565690 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:07.565692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:07.565701 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:06:07.565751 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:07.565753 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:07.565763 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:07.565811 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:07.566044 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.566519 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.567152 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.567335 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.567389 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.569705 (+ 2316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:52587: BlockingRecv error: recv got EOF from 127.29.82.65:52587 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 07:06:07.569896 10956 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:06:07.640012 10962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:07.640229 10962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:07.640254 10962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:07.641489 10962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:07.641535 10962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:07.641562 10962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:06:07.643041 10962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.66.keytab
--principal=oryx/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:32769
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=34783
--tserver_master_addrs=127.29.82.126:46447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:07.643271 10962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:07.643507 10962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:07.648497 10971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:07.648592 10962 server_base.cc:1034] running on GCE node
W20260808 07:06:07.648685 10970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:07.648550 10973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:07.648931 10962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:07.649236 10962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:07.650388 10962 hybrid_clock.cc:648] HybridClock initialized: now 1786172767650371 us; error 29 us; skew 500 ppm
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172767, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:07.652972 10962 init.cc:377] Logged in from keytab as oryx/127.29.82.66@KRBTEST.COM (short username oryx)
I20260808 07:06:07.653469 10962 webserver.cc:460] Webserver started at http://127.29.82.66:34783/ using document root <none> and password file <none>
I20260808 07:06:07.653729 10962 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:07.653797 10962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:07.655157 10962 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:06:07.655771 10982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:07.655978 10962 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:06:07.656067 10962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "9b1a734b96434a4695ceaa8252def835"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-rmhg"
server_key: "99502ddabf8c4fb4172a5759bcd1ef23"
server_key_iv: "47664ff873d502a527185f3faaee89c1"
server_key_version: "encryptionkey@0"
I20260808 07:06:07.656406 10962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:07.676111 10962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:07.678324 10962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:07.678481 10962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:07.678737 10962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:07.679069 10962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:07.679104 10962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:07.679136 10962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:07.679152 10962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:07.684998 10962 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:32769
I20260808 07:06:07.685065 11140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:32769 every 8 connection(s)
I20260808 07:06:07.685441 10962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:06:07.689536 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 10962
I20260808 07:06:07.689868 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:41061
--local_ip_for_outbound_sockets=127.29.82.67
--tserver_master_addrs=127.29.82.126:46447
--webserver_port=39067
--webserver_interface=127.29.82.67
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.29.82.67
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:07.693078 11145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:07.686178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:58693)
0808 07:06:07.686366 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:07.686412 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:07.686893 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:07.687137 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:07.687141 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:07.687734 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:07.687949 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.687954 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.688649 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.688650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.689535 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.689538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.690145 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.690146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.690298 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.690816 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:07.690826 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:07.692922 (+ 2096us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":89,"threads_started":1}
W20260808 07:06:07.693082 10960 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:07.686197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:58693 (local address 127.29.82.126:46447)
0808 07:06:07.686267 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:07.686269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:07.686548 (+ 279us) server_negotiation.cc:407] Connection header received
0808 07:06:07.686994 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:07.686995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:07.687012 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:07.687075 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:07.688048 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.688560 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.689674 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.689978 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.690060 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.693033 (+ 2973us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:58693: BlockingRecv error: recv got EOF from 127.29.82.66:58693 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260808 07:06:07.693460 11141 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:46447 (0 consecutive failures): Not authorized: Failed to ping master at 127.29.82.126:46447: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:07.697896 11145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:07.693687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:43075)
0808 07:06:07.693749 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:07.693759 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:07.693799 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:07.693913 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:07.693914 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:07.694038 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:07.694084 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.694086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.694697 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.694698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.695222 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.695224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.695531 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.695532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.695604 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.696048 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:07.696053 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:07.697842 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 07:06:07.698031 10960 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:07.693743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:43075 (local address 127.29.82.126:46447)
0808 07:06:07.693808 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:07.693810 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:07.693820 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:06:07.693848 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:07.693849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:07.693858 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:07.693905 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:07.694153 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.694628 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.695295 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.695475 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.695528 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.697965 (+ 2437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:43075: BlockingRecv error: recv got EOF from 127.29.82.66:43075 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:07.702622 11145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:07.698202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:56145)
0808 07:06:07.698236 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:07.698248 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:07.698287 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:07.698473 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:07.698474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:07.698576 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:07.698630 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.698631 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.699484 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.699485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.699978 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.699979 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.700410 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.700411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.700447 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.700866 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:07.700870 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:07.702573 (+ 1703us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":16}
W20260808 07:06:07.702736 10960 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:07.698299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:56145 (local address 127.29.82.126:46447)
0808 07:06:07.698356 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:07.698358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:07.698368 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:06:07.698392 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:07.698393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:07.698403 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:07.698469 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:07.698696 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.699411 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.700054 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.700342 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.700417 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.702673 (+ 2256us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:56145: BlockingRecv error: recv got EOF from 127.29.82.66:56145 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260808 07:06:07.702754 11141 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:06:07.775851 11146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:07.776108 11146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:07.776134 11146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:07.777354 11146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:07.777393 11146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:07.777418 11146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:06:07.778868 11146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/krb5kdc/oryx_127.29.82.67.keytab
--principal=oryx/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:41061
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=39067
--tserver_master_addrs=127.29.82.126:46447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:07.779081 11146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:07.779269 11146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:06:07.784312 11146 server_base.cc:1034] running on GCE node
W20260808 07:06:07.784390 11156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:07.784447 11151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:07.784389 11154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:07.784689 11146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:07.784919 11146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:07.786058 11146 hybrid_clock.cc:648] HybridClock initialized: now 1786172767786048 us; error 31 us; skew 500 ppm
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172767, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:07.788462 11146 init.cc:377] Logged in from keytab as oryx/127.29.82.67@KRBTEST.COM (short username oryx)
I20260808 07:06:07.788892 11146 webserver.cc:460] Webserver started at http://127.29.82.67:39067/ using document root <none> and password file <none>
I20260808 07:06:07.789109 11146 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:07.789196 11146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:07.790584 11146 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:07.791106 11166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:07.791260 11146 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:07.791347 11146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "b2c3a0b222344a6f884959faa8109ad3"
format_stamp: "Formatted at 2026-08-08 07:06:07 on dist-test-slave-rmhg"
server_key: "2bb308328b4d1f1b37eba1a5e5ace4ed"
server_key_iv: "805420bccc930731094747c7ec46d454"
server_key_version: "encryptionkey@0"
I20260808 07:06:07.791676 11146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:07.812234 11146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:07.814332 11146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:07.814471 11146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:07.814702 11146 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:07.814999 11146 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:07.815033 11146 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:07.815062 11146 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:07.815094 11146 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:07.820736 11146 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:41061
I20260808 07:06:07.820803 11333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:41061 every 8 connection(s)
I20260808 07:06:07.821187 11146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:06:07.826799 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 11146
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:07.828945 11336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:07.821872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:50299)
0808 07:06:07.822036 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:07.822079 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:07.822598 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:07.822807 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:07.822811 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:07.823442 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:07.823669 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.823674 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.824315 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.824315 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.825228 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.825231 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.825605 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.825606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.825733 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.826223 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:07.826233 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:07.828781 (+ 2548us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":81,"threads_started":1}
W20260808 07:06:07.828945 10960 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:07.821887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:50299 (local address 127.29.82.126:46447)
0808 07:06:07.821949 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:07.821951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:07.822160 (+ 209us) server_negotiation.cc:407] Connection header received
0808 07:06:07.822681 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:07.822682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:07.822692 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:07.822747 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:07.823744 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.824249 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.825297 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.825497 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.825552 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.828881 (+ 3329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:50299: BlockingRecv error: recv got EOF from 127.29.82.67:50299 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260808 07:06:07.829145 11334 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:46447 (0 consecutive failures): Not authorized: Failed to ping master at 127.29.82.126:46447: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:07.833407 11336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:07.829465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:47263)
0808 07:06:07.829513 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:07.829522 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:07.829556 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:07.829665 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:07.829666 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:07.829793 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:07.829836 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.829837 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.830440 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.830441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.830934 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.830935 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.831240 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.831241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.831310 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.831680 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:07.831684 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:07.833352 (+ 1668us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 07:06:07.833509 10960 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:07.829519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:47263 (local address 127.29.82.126:46447)
0808 07:06:07.829560 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:07.829562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:07.829584 (+ 22us) server_negotiation.cc:407] Connection header received
0808 07:06:07.829604 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:07.829605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:07.829613 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:07.829655 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:07.829902 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.830364 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.831002 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.831184 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.831235 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.833450 (+ 2215us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:47263: BlockingRecv error: recv got EOF from 127.29.82.67:47263 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:06:07.834538 11339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:07.827454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38052 (local address 127.29.82.126:46447)
0808 07:06:07.827605 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:07.827607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:07.827616 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:06:07.827640 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:07.827646 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:07.827657 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:07.827716 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:07.828473 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.829068 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.829944 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.830145 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.830203 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.831328 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:07.831335 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:07.831335 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:07.831347 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:07.832925 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:07.833350 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:07.833355 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:07.833355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:07.833495 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:07.833717 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:07.833718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:07.833718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:07.834076 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:07.834206 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:07.834326 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 07:06:07.834440 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:07 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:07.837491 11336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:07.833773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:56641)
0808 07:06:07.833824 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:07.833836 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:07.833872 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:07.833988 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:07.833989 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:07.834089 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:07.834116 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.834117 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.834800 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.834801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.835397 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:07.835400 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.835688 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.835689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:07.835721 (+ 32us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.835999 (+ 278us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:07.836003 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:07.837440 (+ 1437us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 07:06:07.837551 10960 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:07.833837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:56641 (local address 127.29.82.126:46447)
0808 07:06:07.833877 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:07.833879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:07.833888 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:06:07.833907 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:07.833908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:07.833917 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:07.833984 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:07.834186 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.834728 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.835455 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.835634 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.835688 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.837512 (+ 1824us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:56641: BlockingRecv error: recv got EOF from 127.29.82.67:56641 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 07:06:07.837607 11334 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 07:06:08 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:08 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:08.575471 11340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:08.570460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:60737)
0808 07:06:08.570673 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:08.570686 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:08.570753 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:08.570920 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:08.570922 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:08.571103 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:08.571156 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:08.571162 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:08.572054 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:08.572055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:08.572631 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:08.572634 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:08.572971 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:08.572972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:08.573025 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:08.573463 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:08.573480 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:08.575374 (+ 1894us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":117,"threads_started":1}
W20260808 07:06:08.575542 11341 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:08.570576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:60737 (local address 127.29.82.126:46447)
0808 07:06:08.570724 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:08.570726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:08.570739 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:06:08.570804 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:08.570805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:08.570815 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:08.570877 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:08.571332 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:08.571987 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:08.572702 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:08.572899 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:08.572951 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:08.575482 (+ 2531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:60737: BlockingRecv error: recv got EOF from 127.29.82.65:60737 (error 108)
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
Aug 08 07:06:08 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:08 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:08.707777 11342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:08.703179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:46217)
0808 07:06:08.703325 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:08.703337 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:08.703401 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:08.703533 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:08.703534 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:08.703714 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:08.703763 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:08.703764 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:08.704436 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:08.704437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:08.705023 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:08.705025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:08.705408 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:08.705409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:08.705463 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:08.705901 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:08.705906 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:08.707703 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":70,"threads_started":1}
W20260808 07:06:08.707877 11341 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:08.703227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:46217 (local address 127.29.82.126:46447)
0808 07:06:08.703282 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:08.703285 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:08.703394 (+ 109us) server_negotiation.cc:407] Connection header received
0808 07:06:08.703452 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:08.703453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:08.703465 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:08.703514 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:08.703834 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:08.704348 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:08.705104 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:08.705344 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:08.705404 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:08.707808 (+ 2404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:46217: BlockingRecv error: recv got EOF from 127.29.82.66:46217 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 08 07:06:08 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:08 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:08.842548 11343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:08.838026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:42627)
0808 07:06:08.838177 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:08.838189 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:08.838253 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:08.838368 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:08.838369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:08.838537 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:08.838590 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:08.838591 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:08.839202 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:08.839203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:08.839768 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:08.839769 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:08.840149 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:08.840150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:08.840186 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:08.840635 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:08.840640 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:08.842443 (+ 1803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":72,"threads_started":1}
W20260808 07:06:08.842746 11341 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:08.838124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:42627 (local address 127.29.82.126:46447)
0808 07:06:08.838174 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:08.838176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:08.838240 (+ 64us) server_negotiation.cc:407] Connection header received
0808 07:06:08.838297 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:08.838297 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:08.838310 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:08.838354 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:08.838645 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:08.839147 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:08.839867 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:08.840083 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:08.840142 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:08.842679 (+ 2537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:42627: BlockingRecv error: recv got EOF from 127.29.82.67:42627 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 08 07:06:09 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:09 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:09.580976 11344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:09.576089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:51631)
0808 07:06:09.576238 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:09.576249 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:09.576303 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:09.576442 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:09.576443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:09.576616 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:09.576671 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:09.576673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:09.577323 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:09.577323 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:09.578033 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:09.578037 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:09.578398 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:09.578400 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:09.578450 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:09.578901 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:09.578906 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:09.580913 (+ 2007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":68,"threads_started":1}
W20260808 07:06:09.581092 11347 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:09.576180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:51631 (local address 127.29.82.126:46447)
0808 07:06:09.576307 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:09.576309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:09.576319 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:06:09.576348 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:09.576349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:09.576360 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:09.576427 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:09.576732 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:09.577270 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:09.578118 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:09.578327 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:09.578379 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:09.581022 (+ 2643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:51631: BlockingRecv error: recv got EOF from 127.29.82.65:51631 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":64,"threads_started":1}
Aug 08 07:06:09 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:09 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:09.713055 11348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:09.708263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:36721)
0808 07:06:09.708429 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:09.708443 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:09.708520 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:09.708656 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:09.708657 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:09.708843 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:09.708899 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:09.708901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:09.709656 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:09.709657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:09.710193 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:09.710195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:09.710543 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:09.710544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:09.710599 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:09.711071 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:09.711076 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:09.712980 (+ 1904us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":70,"threads_started":1}
W20260808 07:06:09.713217 11347 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:09.708391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:36721 (local address 127.29.82.126:46447)
0808 07:06:09.708497 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:09.708499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:09.708509 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:06:09.708586 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:09.708587 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:09.708600 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:09.708650 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:09.708985 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:09.709561 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:09.710271 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:09.710480 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:09.710537 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:09.713087 (+ 2550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:36721: BlockingRecv error: recv got EOF from 127.29.82.66:36721 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 08 07:06:09 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:09 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:09.847819 11349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:09.843135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:48687)
0808 07:06:09.843293 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:09.843303 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:09.843360 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:09.843568 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:09.843569 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:09.843744 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:09.843794 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:09.843796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:09.844461 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:09.844462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:09.844996 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:09.844998 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:09.845439 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:09.845440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:09.845499 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:09.845936 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:09.845942 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:09.847742 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":66,"threads_started":1}
W20260808 07:06:09.847921 11347 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:09.843308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:48687 (local address 127.29.82.126:46447)
0808 07:06:09.843389 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:09.843390 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:09.843400 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:06:09.843427 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:09.843428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:09.843490 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:09.843538 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:09.843871 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:09.844373 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:09.845077 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:09.845363 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:09.845438 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:09.847858 (+ 2420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:48687: BlockingRecv error: recv got EOF from 127.29.82.67:48687 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 08 07:06:10 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:10 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:10.586120 11350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.581520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:39589)
0808 07:06:10.581651 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.581662 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:10.581723 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:10.581868 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:10.581868 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:10.582044 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:10.582097 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.582099 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.582757 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.582758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.583383 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.583387 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.583801 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.583802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.583868 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.584255 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:10.584258 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:10.586030 (+ 1772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":77,"threads_started":1}
W20260808 07:06:10.586195 11351 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:10.581628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:39589 (local address 127.29.82.126:46447)
0808 07:06:10.581748 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.581750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.581759 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:06:10.581788 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.581788 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.581798 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.581858 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.582161 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.582697 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.583457 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.583720 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.583790 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.586134 (+ 2344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:39589: BlockingRecv error: recv got EOF from 127.29.82.65:39589 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":52,"threads_started":1}
Aug 08 07:06:10 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:10 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:10.718176 11352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.713538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:39823)
0808 07:06:10.713712 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.713726 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:10.713799 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:10.713940 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:10.713942 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:10.714133 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:10.714188 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.714190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.714932 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.714934 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.715556 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.715559 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.715891 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.715892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.715932 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.716419 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:10.716424 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:10.718106 (+ 1682us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":98,"threads_started":1}
W20260808 07:06:10.718259 11351 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:10.713628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:39823 (local address 127.29.82.126:46447)
0808 07:06:10.713716 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.713719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.713787 (+ 68us) server_negotiation.cc:407] Connection header received
0808 07:06:10.713871 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.713872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.713884 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.713931 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.714261 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.714843 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.715635 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.715834 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.715885 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.718200 (+ 2315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:39823: BlockingRecv error: recv got EOF from 127.29.82.66:39823 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 07:06:10 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:10 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:10.852909 11355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.848292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:57595)
0808 07:06:10.848487 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.848501 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:10.848562 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:10.848714 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:10.848715 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:10.848877 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:10.848930 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.848932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.849636 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.849637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.850222 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.850224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.850635 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.850636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.850683 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.851153 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:10.851158 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:10.852844 (+ 1686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":88,"threads_started":1}
W20260808 07:06:10.853003 11351 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:10.848412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:57595 (local address 127.29.82.126:46447)
0808 07:06:10.848573 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.848575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.848582 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:06:10.848606 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.848607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.848649 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.848697 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.849016 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.849560 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.850316 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.850559 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.850625 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.852933 (+ 2308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:57595: BlockingRecv error: recv got EOF from 127.29.82.67:57595 (error 108)
Metrics: {"server-negotiator.queue_time_us":136}
Aug 08 07:06:11 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:11 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:11.591279 11356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:11.586622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:32849)
0808 07:06:11.586786 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:11.586799 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:11.586860 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:11.587013 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:11.587014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:11.587182 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:11.587234 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:11.587235 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:11.588021 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:11.588022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:11.588574 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:11.588576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:11.588933 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:11.588934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:11.588972 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:11.589488 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:11.589494 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:11.591218 (+ 1724us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":65,"threads_started":1}
W20260808 07:06:11.591416 11358 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.586738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:32849 (local address 127.29.82.126:46447)
0808 07:06:11.586853 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.586855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.586864 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:06:11.586919 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.586920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.586930 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.587003 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.587288 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:11.587918 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:11.588666 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:11.588871 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:11.588930 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:11.591339 (+ 2409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:32849: BlockingRecv error: recv got EOF from 127.29.82.65:32849 (error 108)
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":51,"threads_started":1}
Aug 08 07:06:11 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:11 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:11.725975 11360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:11.718664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:36841)
0808 07:06:11.718807 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:11.718821 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:11.718901 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:11.719053 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:11.719054 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:11.719232 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:11.719284 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:11.719286 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:11.719944 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:11.719945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:11.720474 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:11.720476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:11.720830 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:11.720832 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:11.720887 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:11.723963 (+ 3076us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:11.723970 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:11.725891 (+ 1921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":73,"threads_started":1}
W20260808 07:06:11.726090 11358 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.718742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:36841 (local address 127.29.82.126:46447)
0808 07:06:11.718811 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.718814 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.718886 (+ 72us) server_negotiation.cc:407] Connection header received
0808 07:06:11.718963 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.718965 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.718978 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.719040 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.719352 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:11.719865 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:11.720556 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:11.720764 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:11.720822 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:11.726032 (+ 5210us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:36841: BlockingRecv error: recv got EOF from 127.29.82.66:36841 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 07:06:11 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:11 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:11.858196 11361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:11.853454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:37101)
0808 07:06:11.853590 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:11.853601 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:11.853667 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:11.853806 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:11.853808 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:11.853999 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:11.854052 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:11.854055 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:11.854722 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:11.854723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:11.855259 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:11.855261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:11.855602 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:11.855603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:11.855657 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:11.856164 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:11.856169 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:11.858125 (+ 1956us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
W20260808 07:06:11.858279 11358 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.853605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:37101 (local address 127.29.82.126:46447)
0808 07:06:11.853681 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.853683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.853693 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:06:11.853724 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.853725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.853744 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.853791 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.854139 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:11.854642 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:11.855343 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:11.855538 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:11.855594 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:11.858220 (+ 2626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:37101: BlockingRecv error: recv got EOF from 127.29.82.67:37101 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 07:06:12 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:12 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:12.596593 11362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:12.591770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:54471)
0808 07:06:12.591920 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:12.591932 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:12.591993 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:12.592150 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:12.592151 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:12.592346 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:12.592400 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:12.592403 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.593054 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.593056 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:12.593685 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:12.593688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.594105 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.594107 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:12.594167 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:12.594645 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:12.594651 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:12.596464 (+ 1813us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":76,"threads_started":1}
W20260808 07:06:12.596634 11363 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:12.591838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:54471 (local address 127.29.82.126:46447)
0808 07:06:12.591984 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:12.591986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:12.591995 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:06:12.592051 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:12.592052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:12.592065 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:12.592138 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:12.592464 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.592978 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.593780 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.594020 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.594099 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:12.596573 (+ 2474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:54471: BlockingRecv error: recv got EOF from 127.29.82.65:54471 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":89,"threads_started":1}
Aug 08 07:06:12 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:12 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:12.731160 11364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:12.726532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:35639)
0808 07:06:12.726676 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:12.726687 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:12.726750 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:12.726899 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:12.726900 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:12.727087 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:12.727141 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:12.727143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.727810 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.727811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:12.728342 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:12.728343 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.728690 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.728690 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:12.728750 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:12.729243 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:12.729247 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:12.731097 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":62,"threads_started":1}
W20260808 07:06:12.731276 11363 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:12.726672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:35639 (local address 127.29.82.126:46447)
0808 07:06:12.726744 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:12.726746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:12.726756 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:06:12.726806 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:12.726807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:12.726836 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:12.726887 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:12.727219 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.727730 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.728422 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.728627 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.728682 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:12.731203 (+ 2521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:35639: BlockingRecv error: recv got EOF from 127.29.82.66:35639 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 07:06:12 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:12 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:12.863708 11365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:12.858736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:57635)
0808 07:06:12.858907 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:12.858919 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:12.858986 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:12.859125 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:12.859126 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:12.859290 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:12.859344 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:12.859345 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.860131 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.860132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:12.860705 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:12.860708 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.861216 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.861217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:12.861277 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:12.861803 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:12.861808 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:12.863643 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":90,"threads_started":1}
W20260808 07:06:12.863833 11363 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:12.858824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:57635 (local address 127.29.82.126:46447)
0808 07:06:12.858910 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:12.858912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:12.858976 (+ 64us) server_negotiation.cc:407] Connection header received
0808 07:06:12.859040 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:12.859041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:12.859054 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:12.859118 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:12.859436 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.860037 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.860831 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.861035 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.861125 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:12.863763 (+ 2638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:57635: BlockingRecv error: recv got EOF from 127.29.82.67:57635 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 07:06:13 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:13 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:13.601914 11368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.597191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:58791)
0808 07:06:13.597348 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.597360 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:13.597424 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:13.597566 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:13.597566 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:13.597735 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:13.597786 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.597788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.598544 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.598546 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.599174 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.599177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.599545 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.599546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.599595 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.600043 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:13.600048 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:13.601851 (+ 1803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":94,"threads_started":1}
W20260808 07:06:13.602057 11370 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:13.597302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:58791 (local address 127.29.82.126:46447)
0808 07:06:13.597413 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.597415 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.597425 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:06:13.597475 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.597475 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.597485 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.597547 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.597858 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.598476 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.599244 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.599451 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.599505 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.601967 (+ 2462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:58791: BlockingRecv error: recv got EOF from 127.29.82.65:58791 (error 108)
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":53,"threads_started":1}
Aug 08 07:06:13 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:13 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:13.736277 11371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.731643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:34963)
0808 07:06:13.731799 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.731809 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:13.731865 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:13.731978 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:13.731979 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:13.732147 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:13.732198 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.732199 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.732842 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.732843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.733399 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.733401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.733768 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.733769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.733820 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.734273 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:13.734278 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:13.736212 (+ 1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":81,"threads_started":1}
W20260808 07:06:13.736383 11370 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:13.731742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:34963 (local address 127.29.82.126:46447)
0808 07:06:13.731803 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.731805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.731861 (+ 56us) server_negotiation.cc:407] Connection header received
0808 07:06:13.731905 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.731906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.731916 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.731966 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.732253 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.732769 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.733485 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.733692 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.733756 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.736322 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:34963: BlockingRecv error: recv got EOF from 127.29.82.66:34963 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 08 07:06:13 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:13 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:13.869050 11372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.864243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:59917)
0808 07:06:13.864439 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.864452 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:13.864528 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:13.864666 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:13.864667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:13.864865 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:13.864930 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.864932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.865640 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.865641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.866211 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.866214 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.866600 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.866601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.866663 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.867134 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:13.867140 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:13.868986 (+ 1846us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":83,"threads_started":1}
W20260808 07:06:13.869179 11370 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:13.864340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:59917 (local address 127.29.82.126:46447)
0808 07:06:13.864443 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.864445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.864510 (+ 65us) server_negotiation.cc:407] Connection header received
0808 07:06:13.864583 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.864584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.864603 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.864650 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.865014 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.865565 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.866291 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.866526 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.866586 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.869094 (+ 2508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:59917: BlockingRecv error: recv got EOF from 127.29.82.67:59917 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 07:06:14 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:14 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:14.607276 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:14.602444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:50591)
0808 07:06:14.602600 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:14.602613 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:14.602666 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:14.602884 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:14.602886 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:14.603062 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:14.603115 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:14.603116 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:14.603885 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:14.603886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:14.604526 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:14.604528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:14.604858 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:14.604859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:14.604906 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:14.605370 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:14.605375 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:14.607214 (+ 1839us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":102,"threads_started":1}
W20260808 07:06:14.607373 11374 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:14.602583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:50591 (local address 127.29.82.126:46447)
0808 07:06:14.602719 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:14.602721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:14.602730 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:06:14.602757 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:14.602757 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:14.602767 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:14.602835 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:14.603180 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:14.603817 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:14.604592 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:14.604793 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:14.604842 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:14.607306 (+ 2464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:50591: BlockingRecv error: recv got EOF from 127.29.82.65:50591 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
Aug 08 07:06:14 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:14 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:14.741452 11377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:14.736789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:34167)
0808 07:06:14.736941 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:14.736953 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:14.737040 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:14.737175 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:14.737176 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:14.737356 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:14.737407 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:14.737409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:14.738132 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:14.738133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:14.738698 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:14.738700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:14.739027 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:14.739029 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:14.739083 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:14.739509 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:14.739513 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:14.741389 (+ 1876us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":66,"threads_started":1}
W20260808 07:06:14.741611 11374 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:14.736915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:34167 (local address 127.29.82.126:46447)
0808 07:06:14.736986 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:14.736988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:14.737032 (+ 44us) server_negotiation.cc:407] Connection header received
0808 07:06:14.737084 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:14.737085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:14.737096 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:14.737145 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:14.737510 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:14.738030 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:14.738766 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:14.738959 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:14.739011 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:14.741546 (+ 2535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:34167: BlockingRecv error: recv got EOF from 127.29.82.66:34167 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 08 07:06:14 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:14 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:14.874265 11378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:14.869530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:56277)
0808 07:06:14.869719 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:14.869732 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:14.869803 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:14.869931 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:14.869932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:14.870125 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:14.870177 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:14.870179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:14.870899 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:14.870901 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:14.871444 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:14.871446 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:14.871794 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:14.871795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:14.871860 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:14.872331 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:14.872335 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:14.874185 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":98,"threads_started":1}
W20260808 07:06:14.874351 11374 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:14.869630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:56277 (local address 127.29.82.126:46447)
0808 07:06:14.869709 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:14.869711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:14.869785 (+ 74us) server_negotiation.cc:407] Connection header received
0808 07:06:14.869856 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:14.869857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:14.869872 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:14.869917 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:14.870254 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:14.870801 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:14.871529 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:14.871726 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:14.871784 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:14.874294 (+ 2510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:56277: BlockingRecv error: recv got EOF from 127.29.82.67:56277 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 07:06:15 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:15 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:15.613116 11379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:15.607808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:39707)
0808 07:06:15.607964 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:15.607973 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:15.608022 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:15.608198 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:15.608199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:15.608361 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:15.608413 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:15.608414 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.609397 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.609398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:15.610227 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:15.610230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.610716 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.610717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:15.610768 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:15.611240 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:15.611245 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:15.613047 (+ 1802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":73,"threads_started":1}
W20260808 07:06:15.613270 11380 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:15.607936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:39707 (local address 127.29.82.126:46447)
0808 07:06:15.608066 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:15.608068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:15.608079 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:06:15.608106 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:15.608107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:15.608118 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:15.608188 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:15.608471 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.609314 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.610318 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.610642 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.610718 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:15.613191 (+ 2473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:39707: BlockingRecv error: recv got EOF from 127.29.82.65:39707 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":74,"threads_started":1}
Aug 08 07:06:15 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:15 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:15.746800 11381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:15.742074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:38815)
0808 07:06:15.742214 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:15.742229 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:15.742305 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:15.742427 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:15.742428 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:15.742610 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:15.742663 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:15.742665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.743517 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.743518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:15.744063 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:15.744065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.744426 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.744427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:15.744481 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:15.744913 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:15.744917 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:15.746722 (+ 1805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":73,"threads_started":1}
W20260808 07:06:15.746887 11380 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:15.742194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:38815 (local address 127.29.82.126:46447)
0808 07:06:15.742256 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:15.742258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:15.742287 (+ 29us) server_negotiation.cc:407] Connection header received
0808 07:06:15.742362 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:15.742363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:15.742373 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:15.742412 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:15.742737 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.743391 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.744145 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.744343 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.744398 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:15.746832 (+ 2434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:38815: BlockingRecv error: recv got EOF from 127.29.82.66:38815 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 08 07:06:15 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:15 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:15.880756 11384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:15.874862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:56927)
0808 07:06:15.875073 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:15.875085 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:15.875155 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:15.875429 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:15.875430 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:15.875606 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:15.875659 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:15.875660 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.876500 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.876501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:15.877349 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:15.877352 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.877773 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.877775 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:15.877832 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:15.878336 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:15.878341 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:15.880650 (+ 2309us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":83,"threads_started":1}
W20260808 07:06:15.880926 11380 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:15.874974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:56927 (local address 127.29.82.126:46447)
0808 07:06:15.875035 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:15.875037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:15.875180 (+ 143us) server_negotiation.cc:407] Connection header received
0808 07:06:15.875210 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:15.875211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:15.875227 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:15.875284 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:15.875766 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.876392 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.877462 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.877664 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.877734 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:15.880778 (+ 3044us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:56927: BlockingRecv error: recv got EOF from 127.29.82.67:56927 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 08 07:06:16 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:16 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:16.618350 11388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:16.613667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:34947)
0808 07:06:16.613813 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:16.613825 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:16.613889 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:16.614034 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:16.614035 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:16.614207 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:16.614260 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:16.614262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:16.614892 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:16.614893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:16.615417 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:16.615418 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:16.615711 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:16.615712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:16.615752 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:16.616219 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:16.616228 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:16.618273 (+ 2045us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
W20260808 07:06:16.618434 11389 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:16.613743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:34947 (local address 127.29.82.126:46447)
0808 07:06:16.613882 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:16.613883 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:16.613894 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:06:16.613938 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:16.613938 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:16.613950 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:16.614027 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:16.614318 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:16.614832 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:16.615475 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:16.615660 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:16.615702 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:16.618366 (+ 2664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:34947: BlockingRecv error: recv got EOF from 127.29.82.65:34947 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
Aug 08 07:06:16 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:16 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:16.755394 11390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:16.747410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:59685)
0808 07:06:16.747564 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:16.747575 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:16.747643 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:16.747783 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:16.747784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:16.747959 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:16.748015 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:16.748017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:16.748691 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:16.748692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:16.749519 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:16.749523 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:16.749859 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:16.749859 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:16.749900 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:16.753547 (+ 3647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:16.753553 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:16.755324 (+ 1771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":72,"threads_started":1}
W20260808 07:06:16.755492 11389 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:16.747540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:59685 (local address 127.29.82.126:46447)
0808 07:06:16.747607 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:16.747609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:16.747626 (+ 17us) server_negotiation.cc:407] Connection header received
0808 07:06:16.747707 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:16.747708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:16.747719 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:16.747767 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:16.748070 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:16.748597 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:16.749594 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:16.749801 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:16.749855 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:16.755431 (+ 5576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:59685: BlockingRecv error: recv got EOF from 127.29.82.66:59685 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 08 07:06:16 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:16 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:16.886873 11391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:16.881286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:48187)
0808 07:06:16.881443 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:16.881454 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:16.881513 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:16.881623 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:16.881624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:16.881795 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:16.881845 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:16.881847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:16.882453 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:16.882453 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:16.883011 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:16.883013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:16.883314 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:16.883315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:16.883351 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:16.883880 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:16.883885 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:16.886787 (+ 2902us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":76,"threads_started":1}
W20260808 07:06:16.886958 11389 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:16.881339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:48187 (local address 127.29.82.126:46447)
0808 07:06:16.881398 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:16.881400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:16.881505 (+ 105us) server_negotiation.cc:407] Connection header received
0808 07:06:16.881553 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:16.881554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:16.881566 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:16.881613 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:16.881892 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:16.882400 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:16.883076 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:16.883259 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:16.883311 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:16.886901 (+ 3590us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:48187: BlockingRecv error: recv got EOF from 127.29.82.67:48187 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 08 07:06:17 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:17 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:17.623581 11392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:17.618818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:40649)
0808 07:06:17.618984 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:17.618995 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:17.619062 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:17.619204 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:17.619205 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:17.619375 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:17.619438 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:17.619440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:17.620144 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:17.620145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:17.620702 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:17.620704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:17.621080 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:17.621081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:17.621135 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:17.621727 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:17.621732 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:17.623516 (+ 1784us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":69,"threads_started":1}
W20260808 07:06:17.623757 11395 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:17.618930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:40649 (local address 127.29.82.126:46447)
0808 07:06:17.619043 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:17.619045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:17.619055 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:06:17.619109 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:17.619110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:17.619120 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:17.619176 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:17.619510 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:17.620048 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:17.620785 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:17.620992 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:17.621051 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:17.623680 (+ 2629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:40649: BlockingRecv error: recv got EOF from 127.29.82.65:40649 (error 108)
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":50,"threads_started":1}
Aug 08 07:06:17 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:17 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:17.760557 11396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:17.755904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:60383)
0808 07:06:17.756071 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:17.756083 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:17.756144 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:17.756250 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:17.756251 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:17.756416 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:17.756468 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:17.756469 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:17.757185 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:17.757187 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:17.757753 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:17.757756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:17.758107 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:17.758108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:17.758154 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:17.758612 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:17.758616 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:17.760496 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":87,"threads_started":1}
W20260808 07:06:17.760667 11395 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:17.755997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:60383 (local address 127.29.82.126:46447)
0808 07:06:17.756078 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:17.756080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:17.756135 (+ 55us) server_negotiation.cc:407] Connection header received
0808 07:06:17.756187 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:17.756188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:17.756198 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:17.756246 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:17.756535 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:17.757043 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:17.757836 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:17.758044 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:17.758100 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:17.760598 (+ 2498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:60383: BlockingRecv error: recv got EOF from 127.29.82.66:60383 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 07:06:17 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:17 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:17.893008 11397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:17.887415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:60237)
0808 07:06:17.887631 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:17.887644 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:17.887718 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:17.887918 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:17.887919 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:17.888153 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:17.888217 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:17.888220 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:17.889280 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:17.889282 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:17.890154 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:17.890158 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:17.890527 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:17.890528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:17.890574 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:17.891000 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:17.891004 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:17.892917 (+ 1913us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":71,"threads_started":1}
W20260808 07:06:17.893131 11395 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:17.887577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:60237 (local address 127.29.82.126:46447)
0808 07:06:17.887629 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:17.887631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:17.887703 (+ 72us) server_negotiation.cc:407] Connection header received
0808 07:06:17.887787 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:17.887789 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:17.887824 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:17.887887 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:17.888308 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:17.889110 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:17.890243 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:17.890453 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:17.890514 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:17.893058 (+ 2544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:60237: BlockingRecv error: recv got EOF from 127.29.82.67:60237 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 08 07:06:18 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:18 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:18.629937 11398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:18.624107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:51605)
0808 07:06:18.624282 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:18.624298 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:18.624378 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:18.624542 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:18.624543 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:18.624769 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:18.624831 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:18.624833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:18.625715 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:18.625716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:18.626417 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:18.626420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:18.626859 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:18.626860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:18.626923 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:18.627480 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:18.627485 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:18.629821 (+ 2336us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":75,"threads_started":1}
W20260808 07:06:18.630041 11400 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:18.624213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:51605 (local address 127.29.82.126:46447)
0808 07:06:18.624393 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:18.624395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:18.624408 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:06:18.624444 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:18.624445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:18.624459 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:18.624523 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:18.624906 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:18.625576 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:18.626538 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:18.626784 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:18.626841 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:18.629951 (+ 3110us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:51605: BlockingRecv error: recv got EOF from 127.29.82.65:51605 (error 108)
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":92,"threads_started":1}
Aug 08 07:06:18 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:18 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:18.766930 11404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:18.761127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:40431)
0808 07:06:18.761335 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:18.761351 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:18.761453 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:18.761840 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:18.761841 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:18.762106 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:18.762179 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:18.762181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:18.763053 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:18.763054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:18.763738 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:18.763740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:18.764159 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:18.764160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:18.764214 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:18.764788 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:18.764792 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:18.766844 (+ 2052us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":113,"threads_started":1}
W20260808 07:06:18.767066 11400 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:18.761244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:40431 (local address 127.29.82.126:46447)
0808 07:06:18.761330 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:18.761333 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:18.761411 (+ 78us) server_negotiation.cc:407] Connection header received
0808 07:06:18.761544 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:18.761657 (+ 113us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:18.761689 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:18.761797 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:18.762304 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:18.762978 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:18.763831 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:18.764084 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:18.764154 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:18.766981 (+ 2827us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:40431: BlockingRecv error: recv got EOF from 127.29.82.66:40431 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 07:06:18 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:18 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:18.902544 11405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:18.893740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:38443)
0808 07:06:18.894049 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:18.894064 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:18.894198 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:18.895666 (+ 1468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:18.895668 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:18.896042 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:18.896133 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:18.896137 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:18.897235 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:18.897237 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:18.898187 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:18.898191 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:18.898763 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:18.898764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:18.898873 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:18.899550 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:18.899557 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:18.902388 (+ 2831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":165,"threads_started":1}
W20260808 07:06:18.902661 11400 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:18.893969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:38443 (local address 127.29.82.126:46447)
0808 07:06:18.895371 (+ 1402us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:18.895373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:18.895381 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:06:18.895426 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:18.895428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:18.895454 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:18.895560 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:18.896265 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:18.897034 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:18.898334 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:18.898673 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:18.898761 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:18.902576 (+ 3815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:38443: BlockingRecv error: recv got EOF from 127.29.82.67:38443 (error 108)
Metrics: {"server-negotiator.queue_time_us":1352}
Aug 08 07:06:19 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:19 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:19.638759 11406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:19.630780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:42881)
0808 07:06:19.631117 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:19.631142 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:19.631248 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:19.631488 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:19.631489 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:19.631848 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:19.631952 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:19.631961 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:19.632985 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:19.632986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:19.633893 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:19.633896 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:19.634568 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:19.634569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:19.634655 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:19.635396 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:19.635404 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:19.638566 (+ 3162us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":158,"threads_started":1}
W20260808 07:06:19.638857 11407 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:19.630933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:42881 (local address 127.29.82.126:46447)
0808 07:06:19.631121 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:19.631123 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:19.631220 (+ 97us) server_negotiation.cc:407] Connection header received
0808 07:06:19.631324 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:19.631325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:19.631337 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:19.631468 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:19.632052 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:19.632842 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:19.634052 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:19.634404 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:19.634563 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:19.638749 (+ 4186us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:42881: BlockingRecv error: recv got EOF from 127.29.82.65:42881 (error 108)
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":92,"threads_started":1}
Aug 08 07:06:19 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:19 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:19.774752 11408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:19.767628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:49759)
0808 07:06:19.767837 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:19.767856 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:19.767954 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:19.768153 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:19.768154 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:19.768424 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:19.768503 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:19.768505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:19.769537 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:19.769539 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:19.770404 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:19.770407 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:19.770913 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:19.770918 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:19.770988 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:19.771679 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:19.771684 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:19.774664 (+ 2980us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":115,"threads_started":1}
W20260808 07:06:19.774999 11407 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:19.767707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:49759 (local address 127.29.82.126:46447)
0808 07:06:19.767816 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:19.767820 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:19.767938 (+ 118us) server_negotiation.cc:407] Connection header received
0808 07:06:19.768041 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:19.768042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:19.768065 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:19.768134 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:19.768605 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:19.769429 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:19.770521 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:19.770819 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:19.770894 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:19.774840 (+ 3946us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:49759: BlockingRecv error: recv got EOF from 127.29.82.66:49759 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 07:06:19 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:19 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:19.910990 11409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:19.903289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:40731)
0808 07:06:19.903504 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:19.903528 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:19.903646 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:19.903964 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:19.903965 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:19.904332 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:19.904445 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:19.904449 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:19.905598 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:19.905599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:19.906435 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:19.906438 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:19.906983 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:19.906984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:19.907102 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:19.907853 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:19.907859 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:19.910861 (+ 3002us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":116,"threads_started":1}
W20260808 07:06:19.911140 11407 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:19.903416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:40731 (local address 127.29.82.126:46447)
0808 07:06:19.903509 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:19.903512 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:19.903616 (+ 104us) server_negotiation.cc:407] Connection header received
0808 07:06:19.903794 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:19.903795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:19.903860 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:19.903930 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:19.904542 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:19.905488 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:19.906598 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:19.906886 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:19.906983 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:19.911039 (+ 4056us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:40731: BlockingRecv error: recv got EOF from 127.29.82.67:40731 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 07:06:20 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:20 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:20.643708 11410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:20.639374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:56057)
0808 07:06:20.639559 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:20.639569 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:20.639626 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:20.639771 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:20.639772 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:20.639946 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:20.639998 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:20.640000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:20.640621 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:20.640621 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:20.641187 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:20.641189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:20.641475 (+ 286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:20.641476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:20.641513 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:20.641930 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:20.641935 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:20.643646 (+ 1711us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":71,"threads_started":1}
W20260808 07:06:20.643859 11411 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:20.639422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:56057 (local address 127.29.82.126:46447)
0808 07:06:20.639567 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:20.639569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:20.639610 (+ 41us) server_negotiation.cc:407] Connection header received
0808 07:06:20.639686 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:20.639687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:20.639698 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:20.639756 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:20.640052 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:20.640568 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:20.641238 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:20.641426 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:20.641471 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:20.643783 (+ 2312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:56057: BlockingRecv error: recv got EOF from 127.29.82.65:56057 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":83,"threads_started":1}
Aug 08 07:06:20 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:20 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:20.779846 11412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:20.775326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:49367)
0808 07:06:20.775505 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:20.775518 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:20.775572 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:20.775694 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:20.775694 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:20.775865 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:20.775916 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:20.775917 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:20.776541 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:20.776542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:20.777099 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:20.777102 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:20.777518 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:20.777520 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:20.777576 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:20.778022 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:20.778027 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:20.779785 (+ 1758us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":66,"threads_started":1}
W20260808 07:06:20.779958 11411 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:20.775477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:49367 (local address 127.29.82.126:46447)
0808 07:06:20.775547 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:20.775549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:20.775575 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:06:20.775636 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:20.775637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:20.775647 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:20.775686 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:20.775964 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:20.776467 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:20.777244 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:20.777444 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:20.777512 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:20.779888 (+ 2376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:49367: BlockingRecv error: recv got EOF from 127.29.82.66:49367 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 07:06:20 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:20 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:20.916690 11414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:20.911739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:45111)
0808 07:06:20.911894 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:20.911906 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:20.911987 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:20.912124 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:20.912125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:20.912313 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:20.912360 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:20.912362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:20.913125 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:20.913127 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:20.913769 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:20.913772 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:20.914125 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:20.914126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:20.914181 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:20.914653 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:20.914658 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:20.916596 (+ 1938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":101,"threads_started":1}
W20260808 07:06:20.916769 11411 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:20.911785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:45111 (local address 127.29.82.126:46447)
0808 07:06:20.911843 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:20.911845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:20.911976 (+ 131us) server_negotiation.cc:407] Connection header received
0808 07:06:20.912048 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:20.912049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:20.912063 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:20.912111 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:20.912431 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:20.913056 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:20.913855 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:20.914059 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:20.914118 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:20.916710 (+ 2592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:45111: BlockingRecv error: recv got EOF from 127.29.82.67:45111 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 08 07:06:21 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:21 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:21.649293 11415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:21.644281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:51941)
0808 07:06:21.644469 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:21.644480 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:21.644532 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:21.644752 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:21.644753 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:21.644934 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:21.644990 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:21.644992 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:21.645702 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:21.645704 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:21.646263 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:21.646266 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:21.646747 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:21.646748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:21.646811 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:21.647342 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:21.647347 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:21.649230 (+ 1883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
W20260808 07:06:21.649399 11417 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:21.644432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:51941 (local address 127.29.82.126:46447)
0808 07:06:21.644583 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:21.644585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:21.644593 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:06:21.644619 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:21.644620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:21.644630 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:21.644703 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:21.645065 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:21.645625 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:21.646359 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:21.646642 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:21.646711 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:21.649325 (+ 2614us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:51941: BlockingRecv error: recv got EOF from 127.29.82.65:51941 (error 108)
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":81,"threads_started":1}
Aug 08 07:06:21 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:21 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:21.787840 11418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:21.780378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:43147)
0808 07:06:21.780528 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:21.780539 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:21.780601 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:21.780769 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:21.780771 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:21.780950 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:21.781000 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:21.781002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:21.781743 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:21.781744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:21.782299 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:21.782300 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:21.782608 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:21.782609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:21.782657 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:21.785858 (+ 3201us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:21.785864 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:21.787764 (+ 1900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":69,"threads_started":1}
W20260808 07:06:21.787990 11417 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:21.780551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:43147 (local address 127.29.82.126:46447)
0808 07:06:21.780617 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:21.780619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:21.780629 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:06:21.780658 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:21.780659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:21.780669 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:21.780716 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:21.781098 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:21.781664 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:21.782363 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:21.782544 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:21.782586 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:21.787908 (+ 5322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:43147: BlockingRecv error: recv got EOF from 127.29.82.66:43147 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 07:06:21 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:21 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.67@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:21.922027 11419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:21.917257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.67:60191)
0808 07:06:21.917419 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:21.917431 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:21.917512 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:21.917638 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:21.917639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:21.917808 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:21.917856 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:21.917857 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:21.918522 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:21.918523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:21.919063 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:21.919064 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:21.919496 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:21.919498 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:21.919589 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:21.920108 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:21.920114 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:21.921959 (+ 1845us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":70,"threads_started":1}
W20260808 07:06:21.922106 11417 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:21.917352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:60191 (local address 127.29.82.126:46447)
0808 07:06:21.917408 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:21.917410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:21.917527 (+ 117us) server_negotiation.cc:407] Connection header received
0808 07:06:21.917559 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:21.917560 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:21.917573 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:21.917627 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:21.917919 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:21.918451 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:21.919175 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:21.919402 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:21.919477 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:21.922045 (+ 2568us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.67:60191: BlockingRecv error: recv got EOF from 127.29.82.67:60191 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 08 07:06:22 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:22 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.65@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:22.654317 11420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:22.649825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.65:36205)
0808 07:06:22.649948 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:22.649959 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:22.650007 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:22.650122 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:22.650123 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:22.650302 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:22.650353 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:22.650355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:22.651048 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:22.651048 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:22.651572 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:22.651574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:22.651943 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:22.651944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:22.651984 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:22.652428 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:22.652433 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:22.654244 (+ 1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":70,"threads_started":1}
W20260808 07:06:22.654417 11421 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:22.649870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:36205 (local address 127.29.82.126:46447)
0808 07:06:22.649993 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:22.649995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:22.650004 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:06:22.650050 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:22.650051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:22.650062 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:22.650116 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:22.650440 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:22.650983 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:22.651665 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:22.651874 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:22.651937 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:22.654346 (+ 2409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.65:36205: BlockingRecv error: recv got EOF from 127.29.82.65:36205 (error 108)
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":64,"threads_started":1}
Aug 08 07:06:22 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:06:22 dist-test-slave-rmhg krb5kdc[9882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.82.66@KRBTEST.COM for oryx/127.29.82.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:06:22.793105 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:22.788409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46447 (local address 127.29.82.66:38093)
0808 07:06:22.788566 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:22.788578 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:22.788656 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:22.788792 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:22.788793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:22.788973 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:22.789026 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:22.789028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:22.789745 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:22.789746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:22.790283 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:22.790284 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:22.790641 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:22.790642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:22.790678 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:22.791082 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:22.791086 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:22.793013 (+ 1927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.82.126:46447: Server oryx/127.29.82.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":91,"threads_started":1}
W20260808 07:06:22.793231 11421 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:22.788496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:38093 (local address 127.29.82.126:46447)
0808 07:06:22.788599 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:22.788602 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:22.788637 (+ 35us) server_negotiation.cc:407] Connection header received
0808 07:06:22.788714 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:22.788715 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:22.788727 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:22.788777 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:22.789128 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:22.789681 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:22.790369 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:22.790574 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:22.790632 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:22.793144 (+ 2512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.82.66:38093: BlockingRecv error: recv got EOF from 127.29.82.66:38093 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 07:06:22.834761 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 10749
I20260808 07:06:22.848456 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 10962
I20260808 07:06:22.863304 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 11146
I20260808 07:06:22.877121 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 10650
2026-08-08T07:06:22Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17652 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T07:06:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:22Z Disabled control of system clock
I20260808 07:06:22.916769 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:43573
--webserver_interface=127.29.82.126
--webserver_port=0
--builtin_ntp_servers=127.29.82.84:44755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:43573
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 07:06:23.000643 11431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:23.000856 11431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:23.000875 11431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:23.002108 11431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:23.002152 11431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:23.002164 11431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:23.002175 11431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:23.002187 11431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:23.003551 11431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:44755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:43573
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:43573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:23.003808 11431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:23.004096 11431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:23.009116 11440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:23.009338 11431 server_base.cc:1034] running on GCE node
W20260808 07:06:23.009138 11438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:23.009135 11436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:23.009739 11431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:23.010072 11431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:23.011227 11431 hybrid_clock.cc:648] HybridClock initialized: now 1786172783011208 us; error 34 us; skew 500 ppm
I20260808 07:06:23.012521 11431 webserver.cc:460] Webserver started at http://127.29.82.126:33103/ using document root <none> and password file <none>
I20260808 07:06:23.012758 11431 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:23.012809 11431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:23.012943 11431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:23.014099 11431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "cae78c7a2bea425ca5df0f344b6a54d7"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "bfe513cf76dbdcd002a0b125608e5a40"
server_key_iv: "0e20dd638ab4b4865b57dd0390107371"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.014452 11431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "cae78c7a2bea425ca5df0f344b6a54d7"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "bfe513cf76dbdcd002a0b125608e5a40"
server_key_iv: "0e20dd638ab4b4865b57dd0390107371"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.015763 11431 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:06:23.016448 11447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.016619 11431 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:23.016709 11431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "cae78c7a2bea425ca5df0f344b6a54d7"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "bfe513cf76dbdcd002a0b125608e5a40"
server_key_iv: "0e20dd638ab4b4865b57dd0390107371"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.016777 11431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:23.029129 11431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:23.029515 11431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:23.029644 11431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:23.033429 11431 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:43573
I20260808 07:06:23.033473 11519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:43573 every 8 connection(s)
I20260808 07:06:23.033809 11431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:23.034525 11520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:23.037209 11520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7: Bootstrap starting.
I20260808 07:06:23.037806 11520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:23.038084 11520 log.cc:824] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:23.038853 11520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7: No bootstrap required, opened a new log
I20260808 07:06:23.040417 11520 raft_consensus.cc:348] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae78c7a2bea425ca5df0f344b6a54d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43573 } }
I20260808 07:06:23.040560 11520 raft_consensus.cc:374] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:23.040580 11520 raft_consensus.cc:729] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cae78c7a2bea425ca5df0f344b6a54d7, State: Initialized, Role: FOLLOWER
I20260808 07:06:23.040719 11520 consensus_queue.cc:260] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae78c7a2bea425ca5df0f344b6a54d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43573 } }
I20260808 07:06:23.040793 11520 raft_consensus.cc:388] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:23.040817 11520 raft_consensus.cc:482] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:23.040849 11520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:23.041406 11520 raft_consensus.cc:504] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae78c7a2bea425ca5df0f344b6a54d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43573 } }
I20260808 07:06:23.041497 11520 leader_election.cc:302] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cae78c7a2bea425ca5df0f344b6a54d7; no voters:
I20260808 07:06:23.041651 11520 leader_election.cc:288] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:06:23.041668 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 11431
I20260808 07:06:23.041707 11524 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:23.041764 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:06:23.041887 11524 raft_consensus.cc:686] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [term 1 LEADER]: Becoming Leader. State: Replica: cae78c7a2bea425ca5df0f344b6a54d7, State: Running, Role: LEADER
I20260808 07:06:23.041909 11520 sys_catalog.cc:564] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:23.042006 30025 external_mini_cluster.cc:1428] Setting key 95cf39e55cf1f6fa288a9b0f4aa4706a
I20260808 07:06:23.041985 11524 consensus_queue.cc:237] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae78c7a2bea425ca5df0f344b6a54d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43573 } }
I20260808 07:06:23.042346 11527 sys_catalog.cc:455] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cae78c7a2bea425ca5df0f344b6a54d7. Latest consensus state: current_term: 1 leader_uuid: "cae78c7a2bea425ca5df0f344b6a54d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae78c7a2bea425ca5df0f344b6a54d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43573 } } }
I20260808 07:06:23.042454 11527 sys_catalog.cc:458] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:23.042501 11525 sys_catalog.cc:455] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cae78c7a2bea425ca5df0f344b6a54d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae78c7a2bea425ca5df0f344b6a54d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43573 } } }
I20260808 07:06:23.042582 11525 sys_catalog.cc:458] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:23.042762 11530 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:23.043370 11530 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:23.045320 11530 catalog_manager.cc:1347] Generated new cluster ID: 0b1940c3b41042f0b7d335049b71c947
I20260808 07:06:23.045372 11530 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:06:23.048331 11531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:23.042507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40216 (local address 127.29.82.126:43573)
0808 07:06:23.042933 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:23.042943 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:23.042973 (+ 30us) server_negotiation.cc:407] Connection header received
0808 07:06:23.043126 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:23.043132 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:23.043205 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:23.043357 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:23.043725 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:23.045014 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:23.046145 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:23.046776 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:23.046905 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:23.047603 (+ 698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:23.047607 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:23.047608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:23.047819 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:23.047863 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:23.047878 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:23.047951 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:23.048018 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 07:06:23.048113 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":71,"threads_started":1}
I20260808 07:06:23.052601 11530 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:23.053323 11530 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:23.064096 11530 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cae78c7a2bea425ca5df0f344b6a54d7: Generated new TSK 0
I20260808 07:06:23.064328 11530 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:06:23.073606 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:43573
--builtin_ntp_servers=127.29.82.84:44755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 07:06:23.159008 11552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:23.159235 11552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:23.159265 11552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:23.160431 11552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:23.160473 11552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:23.160506 11552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:06:23.161900 11552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:44755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:43573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:23.162171 11552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:23.162470 11552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:23.167488 11563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:23.167495 11559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:23.167536 11560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:23.167860 11552 server_base.cc:1034] running on GCE node
I20260808 07:06:23.168068 11552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:23.168323 11552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:23.169468 11552 hybrid_clock.cc:648] HybridClock initialized: now 1786172783169452 us; error 32 us; skew 500 ppm
I20260808 07:06:23.170768 11552 webserver.cc:460] Webserver started at http://127.29.82.65:40965/ using document root <none> and password file <none>
I20260808 07:06:23.170992 11552 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:23.171037 11552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:23.171167 11552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:23.172253 11552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "200fe0e65deb452290853e34d1ca30d6"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "5bc6dd7107abe6bcca1993246a536e00"
server_key_iv: "3439e111b899e2cf86ea9844c93f1243"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.172600 11552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "200fe0e65deb452290853e34d1ca30d6"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "5bc6dd7107abe6bcca1993246a536e00"
server_key_iv: "3439e111b899e2cf86ea9844c93f1243"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.173969 11552 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:06:23.174664 11573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.174842 11552 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:23.174940 11552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "200fe0e65deb452290853e34d1ca30d6"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "5bc6dd7107abe6bcca1993246a536e00"
server_key_iv: "3439e111b899e2cf86ea9844c93f1243"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.174998 11552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:23.219868 11552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:23.220196 11552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:23.220320 11552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:23.220597 11552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:23.220969 11552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:23.221015 11552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.221056 11552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:23.221079 11552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.226939 11552 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:41163
I20260808 07:06:23.226994 11734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:41163 every 8 connection(s)
I20260808 07:06:23.227339 11552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:06:23.230105 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 11552
I20260808 07:06:23.230193 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:06:23.230370 30025 external_mini_cluster.cc:1428] Setting key 71ecf75b2d81cc96e033b90e4079442a
I20260808 07:06:23.231253 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:43573
--builtin_ntp_servers=127.29.82.84:44755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 07:06:23.232914 11531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:23.228097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:56541 (local address 127.29.82.126:43573)
0808 07:06:23.228161 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:23.228163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:23.228403 (+ 240us) server_negotiation.cc:407] Connection header received
0808 07:06:23.228994 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:23.228995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:23.229008 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:23.229070 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:23.229808 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:23.230378 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:23.231528 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:23.231728 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:23.231783 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:23.232648 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:23.232649 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:23.232650 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:23.232654 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:23.232670 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:23.232674 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:23.232717 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:23.232800 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 07:06:23.232834 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 07:06:23.233130 11738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:23.228073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43573 (local address 127.29.82.65:56541)
0808 07:06:23.228279 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:23.228322 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:23.228806 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:23.229141 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:23.229145 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:23.229185 (+ 40us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:23.229701 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:23.229707 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:23.230473 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:23.230474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:23.231441 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:23.231444 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:23.231801 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:23.231802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:23.231941 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:23.232477 (+ 536us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:06:23.232478 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:23.232507 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:06:23.232531 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:23.232724 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:23.232730 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:23.232734 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:06:23.232799 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 07:06:23.232911 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":85,"threads_started":1}
I20260808 07:06:23.233652 11735 heartbeater.cc:347] Connected to a master server at 127.29.82.126:43573
I20260808 07:06:23.233760 11735 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:23.233970 11735 heartbeater.cc:511] Master 127.29.82.126:43573 requested a full tablet report, sending...
I20260808 07:06:23.234529 11472 ts_manager.cc:194] Registered new tserver with Master: 200fe0e65deb452290853e34d1ca30d6 (127.29.82.65:41163)
I20260808 07:06:23.235154 11472 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.82.65:56541
W20260808 07:06:23.316290 11739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:23.316512 11739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:23.316533 11739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:23.317750 11739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:23.317799 11739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:23.317824 11739 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:06:23.319180 11739 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:44755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:43573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:23.319438 11739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:23.319794 11739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:23.324887 11746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:23.325023 11739 server_base.cc:1034] running on GCE node
W20260808 07:06:23.324936 11745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:23.324921 11748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:23.325372 11739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:23.325624 11739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:23.326768 11739 hybrid_clock.cc:648] HybridClock initialized: now 1786172783326753 us; error 30 us; skew 500 ppm
I20260808 07:06:23.328023 11739 webserver.cc:460] Webserver started at http://127.29.82.66:42329/ using document root <none> and password file <none>
I20260808 07:06:23.328248 11739 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:23.328298 11739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:23.328436 11739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:23.329624 11739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "0031aaa098a342ba930d1766bcb6d736"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "0097d57ec22f9485134d708abae53bcd"
server_key_iv: "185c184a002edce83545822eded196c8"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.329993 11739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "0031aaa098a342ba930d1766bcb6d736"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "0097d57ec22f9485134d708abae53bcd"
server_key_iv: "185c184a002edce83545822eded196c8"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.331346 11739 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:06:23.332132 11757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.332304 11739 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:23.332394 11739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "0031aaa098a342ba930d1766bcb6d736"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "0097d57ec22f9485134d708abae53bcd"
server_key_iv: "185c184a002edce83545822eded196c8"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.332456 11739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:23.344429 11739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:23.344741 11739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:23.344848 11739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:23.345049 11739 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:23.345431 11739 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:23.345475 11739 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.345497 11739 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:23.345512 11739 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.351107 11739 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:39037
I20260808 07:06:23.351173 11926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:39037 every 8 connection(s)
I20260808 07:06:23.351508 11739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:06:23.356727 11531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:23.352317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:50845 (local address 127.29.82.126:43573)
0808 07:06:23.352398 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:23.352400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:23.352625 (+ 225us) server_negotiation.cc:407] Connection header received
0808 07:06:23.353095 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:23.353096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:23.353107 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:23.353212 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:23.353930 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:23.354445 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:23.355428 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:23.355650 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:23.355703 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:23.356495 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:23.356496 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:23.356496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:23.356501 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:23.356513 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:23.356517 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:23.356555 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:23.356633 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 07:06:23.356661 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 07:06:23.356884 11930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:23.352284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43573 (local address 127.29.82.66:50845)
0808 07:06:23.352482 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:23.352524 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:23.353011 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:23.353286 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:23.353290 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:23.353298 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:23.353846 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:23.353851 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:23.354514 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:23.354515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:23.355348 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:23.355350 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:23.355714 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:23.355715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:23.355824 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:23.356369 (+ 545us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:06:23.356370 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:23.356401 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:06:23.356426 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:23.356557 (+ 131us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:23.356560 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:23.356562 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:06:23.356611 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:06:23.356695 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
I20260808 07:06:23.357434 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 11739
I20260808 07:06:23.357509 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:06:23.357707 30025 external_mini_cluster.cc:1428] Setting key 2abdff54e805beaf39675aa090cf11e7
I20260808 07:06:23.357952 11927 heartbeater.cc:347] Connected to a master server at 127.29.82.126:43573
I20260808 07:06:23.358043 11927 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:23.358237 11927 heartbeater.cc:511] Master 127.29.82.126:43573 requested a full tablet report, sending...
I20260808 07:06:23.358606 11472 ts_manager.cc:194] Registered new tserver with Master: 0031aaa098a342ba930d1766bcb6d736 (127.29.82.66:39037)
I20260808 07:06:23.358639 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:43573
--builtin_ntp_servers=127.29.82.84:44755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 07:06:23.359022 11472 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.82.66:50845
W20260808 07:06:23.441634 11931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:23.441854 11931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:23.441875 11931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:23.443135 11931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:23.443176 11931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:23.443202 11931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:06:23.444667 11931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:44755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:43573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:23.444876 11931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:23.445137 11931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:23.450070 11938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:23.450089 11941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:23.450143 11939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:23.450299 11931 server_base.cc:1034] running on GCE node
I20260808 07:06:23.450541 11931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:23.450744 11931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:23.451877 11931 hybrid_clock.cc:648] HybridClock initialized: now 1786172783451868 us; error 29 us; skew 500 ppm
I20260808 07:06:23.453220 11931 webserver.cc:460] Webserver started at http://127.29.82.67:39431/ using document root <none> and password file <none>
I20260808 07:06:23.453447 11931 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:23.453493 11931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:23.453627 11931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:23.454704 11931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "f3acdf5d53144bf097c17726da51b90f"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "882e439621a7065e432e11855ed106b9"
server_key_iv: "939c8d303d4ce500d379f120220df930"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.455037 11931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "f3acdf5d53144bf097c17726da51b90f"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "882e439621a7065e432e11855ed106b9"
server_key_iv: "939c8d303d4ce500d379f120220df930"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.456311 11931 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:06:23.456959 11947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.457118 11931 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:06:23.457237 11931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "f3acdf5d53144bf097c17726da51b90f"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "882e439621a7065e432e11855ed106b9"
server_key_iv: "939c8d303d4ce500d379f120220df930"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.457306 11931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:23.473850 11931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:23.474164 11931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:23.474287 11931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:23.474524 11931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:23.474835 11931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:23.474867 11931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.474889 11931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:23.474903 11931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.480410 11931 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:46249
I20260808 07:06:23.480479 12108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:46249 every 8 connection(s)
I20260808 07:06:23.480814 11931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:06:23.484689 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 11931
I20260808 07:06:23.484781 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:06:23.484982 30025 external_mini_cluster.cc:1428] Setting key a20469bc0b8d2c7469043baf74fb2c93
I20260808 07:06:23.486264 11531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:23.481562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:37243 (local address 127.29.82.126:43573)
0808 07:06:23.481646 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:23.481649 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:23.481857 (+ 208us) server_negotiation.cc:407] Connection header received
0808 07:06:23.482400 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:23.482402 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:23.482417 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:23.482466 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:23.483192 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:23.483708 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:23.484745 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:23.484996 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:23.485056 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:23.485974 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:23.485976 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:23.485977 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:23.485982 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:23.486000 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:23.486004 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:23.486051 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:23.486144 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 07:06:23.486181 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:06:23.486472 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:23.481538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:43573 (local address 127.29.82.67:37243)
0808 07:06:23.481733 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:23.481769 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:23.482289 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:23.482556 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:23.482561 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:23.482570 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:23.483085 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:23.483090 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:23.483801 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:23.483802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:23.484650 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:23.484652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:23.485078 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:23.485079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:23.485252 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:23.485834 (+ 582us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:06:23.485834 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:23.485867 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:06:23.485892 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:23.486057 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:23.486063 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:23.486067 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:06:23.486146 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 07:06:23.486260 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":76,"threads_started":1}
I20260808 07:06:23.486905 12109 heartbeater.cc:347] Connected to a master server at 127.29.82.126:43573
I20260808 07:06:23.486996 12109 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:23.487190 12109 heartbeater.cc:511] Master 127.29.82.126:43573 requested a full tablet report, sending...
I20260808 07:06:23.487537 11472 ts_manager.cc:194] Registered new tserver with Master: f3acdf5d53144bf097c17726da51b90f (127.29.82.67:46249)
I20260808 07:06:23.487901 11472 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.82.67:37243
I20260808 07:06:23.496774 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 07:06:23.498674 11531 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:23.498185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40228 (local address 127.29.82.126:43573)
0808 07:06:23.498253 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:23.498255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:23.498346 (+ 91us) server_negotiation.cc:407] Connection header received
0808 07:06:23.498389 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:23.498390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:23.498401 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:23.498453 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:23.498582 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40228: BlockingRecv error: recv got EOF from 127.0.0.1:40228 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:06:23.498744 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 11552
I20260808 07:06:23.520924 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 11739
I20260808 07:06:23.535544 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 11931
I20260808 07:06:23.539968 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 11431
2026-08-08T07:06:23Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (658 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T07:06:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:23Z Disabled control of system clock
I20260808 07:06:23.574256 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:40959
--webserver_interface=127.29.82.126
--webserver_port=0
--builtin_ntp_servers=127.29.82.84:44157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:40959
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 07:06:23.656903 12123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:23.657172 12123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:23.657198 12123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:23.658447 12123 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:23.658488 12123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:23.658499 12123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:23.658514 12123 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:23.658537 12123 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:23.659953 12123 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:44157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:40959
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:40959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:23.660203 12123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:23.660487 12123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:23.665350 12136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:23.665400 12123 server_base.cc:1034] running on GCE node
W20260808 07:06:23.665349 12132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:23.665356 12133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:23.665815 12123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:23.666090 12123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:23.667234 12123 hybrid_clock.cc:648] HybridClock initialized: now 1786172783667223 us; error 29 us; skew 500 ppm
I20260808 07:06:23.668506 12123 webserver.cc:460] Webserver started at http://127.29.82.126:46553/ using document root <none> and password file <none>
I20260808 07:06:23.668744 12123 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:23.668790 12123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:23.668917 12123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:23.670089 12123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "ff445c552a0c4fdda9673796457e9a40"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "043e0b449fbd500fc364a1616f3acf1b"
server_key_iv: "57da92e61b08cf1b827b1922a5167296"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.670437 12123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "ff445c552a0c4fdda9673796457e9a40"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "043e0b449fbd500fc364a1616f3acf1b"
server_key_iv: "57da92e61b08cf1b827b1922a5167296"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.671708 12123 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:06:23.672425 12144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.672569 12123 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:06:23.672662 12123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "ff445c552a0c4fdda9673796457e9a40"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "043e0b449fbd500fc364a1616f3acf1b"
server_key_iv: "57da92e61b08cf1b827b1922a5167296"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.672735 12123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:23.676170 12123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:23.676442 12123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:23.676563 12123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:23.680497 12123 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:40959
I20260808 07:06:23.680531 12216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:40959 every 8 connection(s)
I20260808 07:06:23.680862 12123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:23.681628 12217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:23.684544 12217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40: Bootstrap starting.
I20260808 07:06:23.685197 12217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:23.685497 12217 log.cc:824] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:23.686283 12217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40: No bootstrap required, opened a new log
I20260808 07:06:23.687909 12217 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff445c552a0c4fdda9673796457e9a40" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 40959 } }
I20260808 07:06:23.688061 12217 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:23.688086 12217 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff445c552a0c4fdda9673796457e9a40, State: Initialized, Role: FOLLOWER
I20260808 07:06:23.688237 12217 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff445c552a0c4fdda9673796457e9a40" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 40959 } }
I20260808 07:06:23.688305 12217 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:23.688328 12217 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:23.688367 12217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:23.688934 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 12123
I20260808 07:06:23.689051 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:06:23.689240 12217 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff445c552a0c4fdda9673796457e9a40" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 40959 } }
I20260808 07:06:23.689311 30025 external_mini_cluster.cc:1428] Setting key 2e14216eb5977a25e94e8b4b4510e531
I20260808 07:06:23.689361 12217 leader_election.cc:302] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff445c552a0c4fdda9673796457e9a40; no voters:
I20260808 07:06:23.689546 12217 leader_election.cc:288] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:06:23.689602 12221 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:23.689826 12217 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:23.689828 12221 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [term 1 LEADER]: Becoming Leader. State: Replica: ff445c552a0c4fdda9673796457e9a40, State: Running, Role: LEADER
I20260808 07:06:23.690075 12221 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff445c552a0c4fdda9673796457e9a40" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 40959 } }
I20260808 07:06:23.690682 12222 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff445c552a0c4fdda9673796457e9a40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff445c552a0c4fdda9673796457e9a40" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 40959 } } }
I20260808 07:06:23.690769 12222 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:23.690968 12235 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:23.691015 12225 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff445c552a0c4fdda9673796457e9a40. Latest consensus state: current_term: 1 leader_uuid: "ff445c552a0c4fdda9673796457e9a40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff445c552a0c4fdda9673796457e9a40" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 40959 } } }
I20260808 07:06:23.691367 12225 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:23.691847 12235 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:23.692098 12226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:23.689931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38076 (local address 127.29.82.126:40959)
0808 07:06:23.690203 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:23.690212 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:23.690244 (+ 32us) server_negotiation.cc:407] Connection header received
0808 07:06:23.690369 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:23.690378 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:23.690429 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:23.690632 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:23.691374 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:23.691377 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:23.691378 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:23.691382 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:23.691422 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:23.691436 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:23.691740 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:23.691772 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 07:06:23.691839 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":88,"threads_started":1}
I20260808 07:06:23.693679 12235 catalog_manager.cc:1347] Generated new cluster ID: bf5621a40e7b498c847306af0c28aea7
I20260808 07:06:23.693734 12235 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:06:23.702816 12235 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:23.702998 12235 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:23.708451 12235 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff445c552a0c4fdda9673796457e9a40: Generated new TSK 0
I20260808 07:06:23.708678 12235 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:06:23.715293 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:40959
--builtin_ntp_servers=127.29.82.84:44157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 07:06:23.800252 12251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:23.800477 12251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:23.800503 12251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:23.801730 12251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:23.801777 12251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:23.801805 12251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:06:23.803193 12251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:44157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:40959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:23.803440 12251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:23.803759 12251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:23.809871 12263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:23.810019 12251 server_base.cc:1034] running on GCE node
W20260808 07:06:23.809834 12257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:23.809851 12260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:23.810297 12251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:23.810549 12251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:23.811733 12251 hybrid_clock.cc:648] HybridClock initialized: now 1786172783811717 us; error 33 us; skew 500 ppm
I20260808 07:06:23.813038 12251 webserver.cc:460] Webserver started at http://127.29.82.65:44243/ using document root <none> and password file <none>
I20260808 07:06:23.813314 12251 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:23.813371 12251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:23.813509 12251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:23.814599 12251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "a635663c864d4fb2bc39361314ae204b"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "8de7f1a7377336c3174c67d6665fef44"
server_key_iv: "658f54afa345fcd622c9a3029cf77f17"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.814945 12251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "a635663c864d4fb2bc39361314ae204b"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "8de7f1a7377336c3174c67d6665fef44"
server_key_iv: "658f54afa345fcd622c9a3029cf77f17"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.816239 12251 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:06:23.817004 12271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.817196 12251 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:23.817291 12251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "a635663c864d4fb2bc39361314ae204b"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "8de7f1a7377336c3174c67d6665fef44"
server_key_iv: "658f54afa345fcd622c9a3029cf77f17"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.817359 12251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:23.820701 12251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:23.820991 12251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:23.821120 12251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:23.821352 12251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:23.821666 12251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:23.821702 12251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.821728 12251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:23.821753 12251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.827368 12251 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:43393
I20260808 07:06:23.827428 12431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:43393 every 8 connection(s)
I20260808 07:06:23.827744 12251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:06:23.830636 12226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:23.828465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:43403 (local address 127.29.82.126:40959)
0808 07:06:23.828561 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:23.828563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:23.828737 (+ 174us) server_negotiation.cc:407] Connection header received
0808 07:06:23.829243 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:23.829244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:23.829251 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:23.829310 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:23.830396 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:23.830397 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:23.830398 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:23.830402 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:23.830418 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:23.830422 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:23.830514 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:23.830568 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 07:06:23.830580 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 07:06:23.830924 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 12251
I20260808 07:06:23.831008 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:06:23.831199 30025 external_mini_cluster.cc:1428] Setting key a7cddb8d1d591ce93d664dfc4c75c56e
I20260808 07:06:23.831420 12435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:23.828429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:40959 (local address 127.29.82.65:43403)
0808 07:06:23.828617 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:23.828658 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:23.829114 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:23.829370 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:23.829374 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:23.829383 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:23.830247 (+ 864us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:06:23.830247 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:23.830276 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:06:23.830306 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:23.830515 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:23.830518 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:23.830520 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:06:23.830569 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:06:23.830619 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":75,"threads_started":1}
I20260808 07:06:23.831845 12433 heartbeater.cc:347] Connected to a master server at 127.29.82.126:40959
I20260808 07:06:23.831943 12433 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:23.832095 12433 heartbeater.cc:511] Master 127.29.82.126:40959 requested a full tablet report, sending...
I20260808 07:06:23.832175 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:40959
--builtin_ntp_servers=127.29.82.84:44157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 07:06:23.832634 12166 ts_manager.cc:194] Registered new tserver with Master: a635663c864d4fb2bc39361314ae204b (127.29.82.65:43393)
W20260808 07:06:23.916586 12436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:23.916801 12436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:23.916823 12436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:23.918076 12436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:23.918118 12436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:23.918143 12436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:06:23.919502 12436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:44157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:40959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:23.919739 12436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:23.920092 12436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:23.924917 12443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:23.924923 12446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:23.924988 12444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:23.925293 12436 server_base.cc:1034] running on GCE node
I20260808 07:06:23.925490 12436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:23.925722 12436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:23.926849 12436 hybrid_clock.cc:648] HybridClock initialized: now 1786172783926840 us; error 26 us; skew 500 ppm
I20260808 07:06:23.928048 12436 webserver.cc:460] Webserver started at http://127.29.82.66:45887/ using document root <none> and password file <none>
I20260808 07:06:23.928296 12436 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:23.928341 12436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:23.928470 12436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:23.929593 12436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "b580d980540f43cab16d76a905c9b948"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "be97808007651a38fa7ac55590f9a299"
server_key_iv: "2fb0807a65c5b8eedfed67e3fcd9245c"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.929921 12436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "b580d980540f43cab16d76a905c9b948"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "be97808007651a38fa7ac55590f9a299"
server_key_iv: "2fb0807a65c5b8eedfed67e3fcd9245c"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.931252 12436 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:06:23.931946 12455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.932117 12436 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:23.932202 12436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "b580d980540f43cab16d76a905c9b948"
format_stamp: "Formatted at 2026-08-08 07:06:23 on dist-test-slave-rmhg"
server_key: "be97808007651a38fa7ac55590f9a299"
server_key_iv: "2fb0807a65c5b8eedfed67e3fcd9245c"
server_key_version: "encryptionkey@0"
I20260808 07:06:23.932266 12436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:23.935701 12436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:23.935959 12436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:23.936088 12436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:23.936273 12436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:23.936568 12436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:23.936604 12436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.936630 12436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:23.936654 12436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:23.942286 12436 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:36863
I20260808 07:06:23.942341 12615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:36863 every 8 connection(s)
I20260808 07:06:23.942667 12436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:06:23.945622 12226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:23.943344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:46081 (local address 127.29.82.126:40959)
0808 07:06:23.943391 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:23.943394 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:23.943617 (+ 223us) server_negotiation.cc:407] Connection header received
0808 07:06:23.944113 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:23.944114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:23.944121 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:23.944174 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:23.945377 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:23.945379 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:23.945380 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:23.945385 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:23.945404 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:23.945409 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:23.945469 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:23.945536 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 07:06:23.945551 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:06:23.945818 12623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:23.943321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:40959 (local address 127.29.82.66:46081)
0808 07:06:23.943494 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:23.943529 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:23.944011 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:23.944248 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:23.944252 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:23.944262 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:23.945228 (+ 966us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:06:23.945228 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:23.945259 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:06:23.945290 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:23.945471 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:23.945476 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:23.945480 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:06:23.945547 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 07:06:23.945611 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":69,"threads_started":1}
I20260808 07:06:23.946327 12620 heartbeater.cc:347] Connected to a master server at 127.29.82.126:40959
I20260808 07:06:23.946424 12620 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:23.946557 12620 heartbeater.cc:511] Master 127.29.82.126:40959 requested a full tablet report, sending...
I20260808 07:06:23.946892 12166 ts_manager.cc:194] Registered new tserver with Master: b580d980540f43cab16d76a905c9b948 (127.29.82.66:36863)
I20260808 07:06:23.947695 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 12436
I20260808 07:06:23.947772 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:06:23.947934 30025 external_mini_cluster.cc:1428] Setting key 94bdaaaa2d4f3012d050ef7fbad388b3
I20260808 07:06:23.948769 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:40959
--builtin_ntp_servers=127.29.82.84:44157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 07:06:24.031809 12624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:24.032043 12624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:24.032075 12624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:24.033249 12624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:24.033288 12624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:24.033320 12624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:06:24.034669 12624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:44157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:40959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:24.034947 12624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:24.035252 12624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:24.040417 12630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:24.040418 12636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:24.040418 12631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:24.040680 12624 server_base.cc:1034] running on GCE node
I20260808 07:06:24.040906 12624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:24.041208 12624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:24.042385 12624 hybrid_clock.cc:648] HybridClock initialized: now 1786172784042360 us; error 45 us; skew 500 ppm
I20260808 07:06:24.043716 12624 webserver.cc:460] Webserver started at http://127.29.82.67:40809/ using document root <none> and password file <none>
I20260808 07:06:24.043944 12624 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:24.043990 12624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:24.044093 12624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:24.045215 12624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "a7a0ed3ffaaf4ebeb4ca91d9aa612f29"
format_stamp: "Formatted at 2026-08-08 07:06:24 on dist-test-slave-rmhg"
server_key: "f7a28b059f9633c014bbc94a492b7bc7"
server_key_iv: "14814e991437c7f5bb1133146926214c"
server_key_version: "encryptionkey@0"
I20260808 07:06:24.045548 12624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "a7a0ed3ffaaf4ebeb4ca91d9aa612f29"
format_stamp: "Formatted at 2026-08-08 07:06:24 on dist-test-slave-rmhg"
server_key: "f7a28b059f9633c014bbc94a492b7bc7"
server_key_iv: "14814e991437c7f5bb1133146926214c"
server_key_version: "encryptionkey@0"
I20260808 07:06:24.046842 12624 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:06:24.047488 12645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:24.047633 12624 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:06:24.047719 12624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "a7a0ed3ffaaf4ebeb4ca91d9aa612f29"
format_stamp: "Formatted at 2026-08-08 07:06:24 on dist-test-slave-rmhg"
server_key: "f7a28b059f9633c014bbc94a492b7bc7"
server_key_iv: "14814e991437c7f5bb1133146926214c"
server_key_version: "encryptionkey@0"
I20260808 07:06:24.047787 12624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:24.051683 12624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:24.051928 12624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:24.052043 12624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:24.052253 12624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:24.052552 12624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:24.052593 12624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:24.052613 12624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:24.052624 12624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:24.058162 12624 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:46167
I20260808 07:06:24.058215 12815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:46167 every 8 connection(s)
I20260808 07:06:24.058534 12624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:06:24.061573 12226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:24.059244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:47791 (local address 127.29.82.126:40959)
0808 07:06:24.059303 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:24.059305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:24.059538 (+ 233us) server_negotiation.cc:407] Connection header received
0808 07:06:24.060048 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:24.060050 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:24.060058 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:24.060113 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:24.061320 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:24.061322 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:24.061322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:24.061328 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:24.061343 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:24.061348 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:24.061401 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:24.061476 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 07:06:24.061495 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:06:24.061757 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:24.059216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:40959 (local address 127.29.82.67:47791)
0808 07:06:24.059423 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:24.059458 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:24.059942 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:24.060191 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:24.060194 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:24.060202 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:24.061136 (+ 934us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:06:24.061136 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:24.061198 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:06:24.061230 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:24.061403 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:24.061408 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:24.061412 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:06:24.061484 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 07:06:24.061551 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":92,"threads_started":1}
I20260808 07:06:24.062228 12820 heartbeater.cc:347] Connected to a master server at 127.29.82.126:40959
I20260808 07:06:24.062311 12820 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:24.062433 12820 heartbeater.cc:511] Master 127.29.82.126:40959 requested a full tablet report, sending...
I20260808 07:06:24.062768 12166 ts_manager.cc:194] Registered new tserver with Master: a7a0ed3ffaaf4ebeb4ca91d9aa612f29 (127.29.82.67:46167)
I20260808 07:06:24.064284 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 12624
I20260808 07:06:24.064399 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:06:24.064652 30025 external_mini_cluster.cc:1428] Setting key dd88a12fb5bc19ea3e91e360630151ed
I20260808 07:06:24.065565 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 07:06:24.067301 12226 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:24.066871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38092 (local address 127.29.82.126:40959)
0808 07:06:24.066913 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:24.066915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:24.067023 (+ 108us) server_negotiation.cc:407] Connection header received
0808 07:06:24.067075 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:24.067075 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:24.067081 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:24.067130 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:24.067240 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38092: BlockingRecv error: recv got EOF from 127.0.0.1:38092 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:06:24.067382 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 12251
I20260808 07:06:24.092144 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 12436
I20260808 07:06:24.107254 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 12624
I20260808 07:06:24.122210 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 12123
2026-08-08T07:06:24Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (582 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:24 dist-test-slave-rmhg krb5kdc[12838](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:24 dist-test-slave-rmhg krb5kdc[12838](info): set up 2 sockets
Aug 08 07:06:24 dist-test-slave-rmhg krb5kdc[12838](info): commencing operation
krb5kdc: starting...
W20260808 07:06:25.250144 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:06:25 dist-test-slave-rmhg krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172785, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:06:25.371476 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:41467
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:42057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:41467
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:25.454677 12858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:25.454907 12858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:25.454929 12858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:25.456120 12858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:25.456168 12858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:25.456182 12858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:25.456194 12858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:25.456218 12858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:25.457880 12858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:42057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:41467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:41467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:25.458144 12858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:25.458369 12858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:25.463799 12867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:25.463762 12871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:25.463891 12858 server_base.cc:1034] running on GCE node
W20260808 07:06:25.463762 12868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:25.464306 12858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:25.464634 12858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:25.465799 12858 hybrid_clock.cc:648] HybridClock initialized: now 1786172785465783 us; error 35 us; skew 500 ppm
Aug 08 07:06:25 dist-test-slave-rmhg krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172785, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:25.468400 12858 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:06:25.468881 12858 webserver.cc:460] Webserver started at http://127.29.82.126:37329/ using document root <none> and password file <none>
I20260808 07:06:25.469098 12858 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:25.469179 12858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:25.469327 12858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:25.470413 12858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "ddb34bd11ba44d82bba535ef6da98e26"
format_stamp: "Formatted at 2026-08-08 07:06:25 on dist-test-slave-rmhg"
server_key: "bdcf7d1feb88264ee0b3cf9250220a94"
server_key_iv: "8411c472191f77915fa6aa77aad8bc3e"
server_key_version: "encryptionkey@0"
I20260808 07:06:25.470774 12858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "ddb34bd11ba44d82bba535ef6da98e26"
format_stamp: "Formatted at 2026-08-08 07:06:25 on dist-test-slave-rmhg"
server_key: "bdcf7d1feb88264ee0b3cf9250220a94"
server_key_iv: "8411c472191f77915fa6aa77aad8bc3e"
server_key_version: "encryptionkey@0"
I20260808 07:06:25.472062 12858 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:06:25.472827 12880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:25.472990 12858 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:06:25.473078 12858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "ddb34bd11ba44d82bba535ef6da98e26"
format_stamp: "Formatted at 2026-08-08 07:06:25 on dist-test-slave-rmhg"
server_key: "bdcf7d1feb88264ee0b3cf9250220a94"
server_key_iv: "8411c472191f77915fa6aa77aad8bc3e"
server_key_version: "encryptionkey@0"
I20260808 07:06:25.473179 12858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:25.495066 12858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:25.497385 12858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:25.497534 12858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:25.501536 12858 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:41467
I20260808 07:06:25.501577 12959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:41467 every 8 connection(s)
I20260808 07:06:25.501924 12858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:25.502939 12960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:25.505751 12960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26: Bootstrap starting.
I20260808 07:06:25.506296 12960 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:25.506523 12960 log.cc:824] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:25.507205 12960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26: No bootstrap required, opened a new log
I20260808 07:06:25.507208 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 12858
I20260808 07:06:25.507283 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:06:25.507445 30025 external_mini_cluster.cc:1428] Setting key 97e55735c1a20c64ca99e5b87a0820be
I20260808 07:06:25.509197 12960 raft_consensus.cc:348] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddb34bd11ba44d82bba535ef6da98e26" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41467 } }
I20260808 07:06:25.509383 12960 raft_consensus.cc:374] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:25.509464 12960 raft_consensus.cc:729] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddb34bd11ba44d82bba535ef6da98e26, State: Initialized, Role: FOLLOWER
I20260808 07:06:25.509613 12960 consensus_queue.cc:260] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddb34bd11ba44d82bba535ef6da98e26" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41467 } }
I20260808 07:06:25.509691 12960 raft_consensus.cc:388] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:25.509725 12960 raft_consensus.cc:482] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:25.509774 12960 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:25.510859 12960 raft_consensus.cc:504] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddb34bd11ba44d82bba535ef6da98e26" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41467 } }
I20260808 07:06:25.510973 12960 leader_election.cc:302] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ddb34bd11ba44d82bba535ef6da98e26; no voters:
I20260808 07:06:25.511132 12960 leader_election.cc:288] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:06:25.511186 12966 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:25.511356 12966 raft_consensus.cc:686] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [term 1 LEADER]: Becoming Leader. State: Replica: ddb34bd11ba44d82bba535ef6da98e26, State: Running, Role: LEADER
I20260808 07:06:25.511382 12960 sys_catalog.cc:564] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:25.511513 12966 consensus_queue.cc:237] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddb34bd11ba44d82bba535ef6da98e26" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41467 } }
I20260808 07:06:25.512022 12970 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ddb34bd11ba44d82bba535ef6da98e26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddb34bd11ba44d82bba535ef6da98e26" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41467 } } }
I20260808 07:06:25.513167 12970 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:25.512001 12969 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ddb34bd11ba44d82bba535ef6da98e26. Latest consensus state: current_term: 1 leader_uuid: "ddb34bd11ba44d82bba535ef6da98e26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddb34bd11ba44d82bba535ef6da98e26" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41467 } } }
I20260808 07:06:25.513371 12969 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26 [sys.catalog]: This master's current role is: LEADER
W20260808 07:06:25.513396 12987 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:06:25.513432 12987 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:06:25.513545 12990 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:25.513760 12990 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 07:06:25 dist-test-slave-rmhg krb5kdc[12838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172785, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:06:25.515482 12990 catalog_manager.cc:1347] Generated new cluster ID: 86dd78a9992e4a0e88320253207d2755
I20260808 07:06:25.515527 12990 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:06:25.521108 12965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:25.508000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56250 (local address 127.29.82.126:41467)
0808 07:06:25.508225 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:25.508236 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:25.508272 (+ 36us) server_negotiation.cc:407] Connection header received
0808 07:06:25.509131 (+ 859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:25.509141 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:25.509231 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:25.509388 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:25.510057 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:25.511515 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:25.512501 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:25.513083 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:25.513209 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:25.515996 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:25.516000 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:25.516000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:25.516013 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:25.517933 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:25.518340 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:25.518343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:25.518343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:25.519870 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:25.520108 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:25.520109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:25.520109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:25.520440 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:25.520589 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:25.520719 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 07:06:25.520873 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":109,"threads_started":1}
I20260808 07:06:25.522320 12990 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:25.522822 12990 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:25.527777 12990 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26: Generated new TSK 0
I20260808 07:06:25.527956 12990 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:06:25.555913 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:41467
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:42057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:25.648527 12994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:25.648801 12994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:25.648839 12994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:25.650458 12994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:25.650511 12994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:25.650544 12994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:06:25.652403 12994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:42057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:41467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:25.652765 12994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:25.653096 12994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:25.658595 13004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:25.658732 13008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:25.658591 13005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:25.659482 12994 server_base.cc:1034] running on GCE node
I20260808 07:06:25.659703 12994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:25.659974 12994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:25.661126 12994 hybrid_clock.cc:648] HybridClock initialized: now 1786172785661107 us; error 34 us; skew 500 ppm
Aug 08 07:06:25 dist-test-slave-rmhg krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172785, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:25.664484 12994 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:06:25.664974 12994 webserver.cc:460] Webserver started at http://127.29.82.65:41693/ using document root <none> and password file <none>
I20260808 07:06:25.665256 12994 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:25.665315 12994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:25.665446 12994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:25.666520 12994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "0456de8dbe754a2089c34d9c0fcbfd38"
format_stamp: "Formatted at 2026-08-08 07:06:25 on dist-test-slave-rmhg"
server_key: "3ce06b7a570a4ffceb4dda67530db8c9"
server_key_iv: "c4c0daa8a7d6d9d917aaed2dcd71839e"
server_key_version: "encryptionkey@0"
I20260808 07:06:25.666868 12994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "0456de8dbe754a2089c34d9c0fcbfd38"
format_stamp: "Formatted at 2026-08-08 07:06:25 on dist-test-slave-rmhg"
server_key: "3ce06b7a570a4ffceb4dda67530db8c9"
server_key_iv: "c4c0daa8a7d6d9d917aaed2dcd71839e"
server_key_version: "encryptionkey@0"
I20260808 07:06:25.668241 12994 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:06:25.669050 13018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:25.669260 12994 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:25.669381 12994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "0456de8dbe754a2089c34d9c0fcbfd38"
format_stamp: "Formatted at 2026-08-08 07:06:25 on dist-test-slave-rmhg"
server_key: "3ce06b7a570a4ffceb4dda67530db8c9"
server_key_iv: "c4c0daa8a7d6d9d917aaed2dcd71839e"
server_key_version: "encryptionkey@0"
I20260808 07:06:25.669469 12994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:25.684520 12994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:25.686465 12994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:25.686574 12994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:25.686777 12994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:25.687096 12994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:25.687130 12994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:25.687160 12994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:25.687176 12994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:25.692792 12994 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:41573
I20260808 07:06:25.692857 13188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:41573 every 8 connection(s)
I20260808 07:06:25.693202 12994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:06:25 dist-test-slave-rmhg krb5kdc[12838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172785, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:06:25.702605 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 12994
I20260808 07:06:25.702672 12965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:25.694022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:60879 (local address 127.29.82.126:41467)
0808 07:06:25.694083 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:25.694085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:25.694288 (+ 203us) server_negotiation.cc:407] Connection header received
0808 07:06:25.694805 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:25.694807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:25.694825 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:25.694878 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:25.695874 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:25.696387 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:25.697448 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:25.697677 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:25.697735 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:25.699854 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:25.699855 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:25.699856 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:25.699869 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:25.701338 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:25.701734 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:25.701735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:25.701735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:25.701797 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:25.702017 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:25.702017 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:25.702018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:25.702143 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:25.702202 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:25.702470 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 07:06:25.702576 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:06:25.702708 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:06:25.702827 13193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:25.693948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:41467 (local address 127.29.82.65:60879)
0808 07:06:25.694160 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:25.694200 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:25.694706 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:25.694952 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:25.694955 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:25.695550 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:25.695754 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:25.695759 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:25.696477 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:25.696478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:25.697366 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:25.697369 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:25.697751 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:25.697752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:25.697869 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:25.698377 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:25.698386 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:25.699757 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:25.701418 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:25.701426 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:25.701429 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:25.701661 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:25.701849 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:25.701850 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:25.701850 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:25.701957 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:25.702198 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:25.702206 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:25.702349 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 07:06:25.702441 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 07:06:25.702604 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":81,"threads_started":1}
I20260808 07:06:25.702909 30025 external_mini_cluster.cc:1428] Setting key 16ca41507d2065d6c167f04d792792e3
I20260808 07:06:25.703272 13189 heartbeater.cc:347] Connected to a master server at 127.29.82.126:41467
I20260808 07:06:25.703372 13189 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:25.703558 13189 heartbeater.cc:511] Master 127.29.82.126:41467 requested a full tablet report, sending...
I20260808 07:06:25.704120 12906 ts_manager.cc:194] Registered new tserver with Master: 0456de8dbe754a2089c34d9c0fcbfd38 (127.29.82.65:41573)
I20260808 07:06:25.704926 12906 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:60879
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:06:25.728070 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:41467
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:42057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:25.812505 13196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:25.812722 13196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:25.812755 13196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:25.814116 13196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:25.814170 13196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:25.814208 13196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:06:25.815723 13196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:42057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:41467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:25.815964 13196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:25.816195 13196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:25.821313 13205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:25.821317 13203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:25.821346 13196 server_base.cc:1034] running on GCE node
W20260808 07:06:25.821317 13202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:25.821707 13196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:25.821961 13196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:25.823125 13196 hybrid_clock.cc:648] HybridClock initialized: now 1786172785823111 us; error 32 us; skew 500 ppm
Aug 08 07:06:25 dist-test-slave-rmhg krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172785, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:25.825778 13196 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:06:25.826251 13196 webserver.cc:460] Webserver started at http://127.29.82.66:36447/ using document root <none> and password file <none>
I20260808 07:06:25.826488 13196 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:25.826537 13196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:25.826697 13196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:25.827754 13196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "9e39c20186924f41b56dc8ddc7675cb2"
format_stamp: "Formatted at 2026-08-08 07:06:25 on dist-test-slave-rmhg"
server_key: "b5a145927dd5608eb4f63ca6ad694c8c"
server_key_iv: "61b6e543ae8d940f882be746aafc6ec0"
server_key_version: "encryptionkey@0"
I20260808 07:06:25.828088 13196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "9e39c20186924f41b56dc8ddc7675cb2"
format_stamp: "Formatted at 2026-08-08 07:06:25 on dist-test-slave-rmhg"
server_key: "b5a145927dd5608eb4f63ca6ad694c8c"
server_key_iv: "61b6e543ae8d940f882be746aafc6ec0"
server_key_version: "encryptionkey@0"
I20260808 07:06:25.829425 13196 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:06:25.830179 13218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:25.830353 13196 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:25.830441 13196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "9e39c20186924f41b56dc8ddc7675cb2"
format_stamp: "Formatted at 2026-08-08 07:06:25 on dist-test-slave-rmhg"
server_key: "b5a145927dd5608eb4f63ca6ad694c8c"
server_key_iv: "61b6e543ae8d940f882be746aafc6ec0"
server_key_version: "encryptionkey@0"
I20260808 07:06:25.830502 13196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:25.859598 13196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:25.861936 13196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:25.862083 13196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:25.862332 13196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:25.862651 13196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:25.862686 13196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:25.862716 13196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:25.862740 13196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:25.868462 13196 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:32989
I20260808 07:06:25.868542 13379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:32989 every 8 connection(s)
I20260808 07:06:25.868845 13196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:06:25.874121 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 13196
I20260808 07:06:25.874239 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:06:25.874455 30025 external_mini_cluster.cc:1428] Setting key 9f8b6fb857ff4aa49edc168c874366a6
Aug 08 07:06:25 dist-test-slave-rmhg krb5kdc[12838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172785, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:06:25.878264 12965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:25.869634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:34589 (local address 127.29.82.126:41467)
0808 07:06:25.869688 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:25.869690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:25.869858 (+ 168us) server_negotiation.cc:407] Connection header received
0808 07:06:25.870351 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:25.870353 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:25.870365 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:25.870421 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:25.871379 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:25.871898 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:25.872868 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:25.873062 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:25.873114 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:25.875534 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:25.875536 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:25.875536 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:25.875545 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:25.876915 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:25.877338 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:25.877340 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:25.877340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:25.877402 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:25.877633 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:25.877634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:25.877635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:25.877755 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:25.877813 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:25.878085 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 07:06:25.878173 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:06:25.878439 13384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:25.869549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:41467 (local address 127.29.82.66:34589)
0808 07:06:25.869727 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:25.869771 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:25.870268 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:25.870484 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:25.870488 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:25.871051 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:25.871262 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:25.871267 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:25.871973 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:25.871974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:25.872791 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:25.872794 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:25.873129 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:25.873130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:25.873286 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:25.873792 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:25.873802 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:25.875427 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:25.876982 (+ 1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:25.876991 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:25.876993 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:25.877273 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:25.877454 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:25.877454 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:25.877455 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:25.877576 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:25.877811 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:25.877818 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:25.877961 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 07:06:25.878057 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 07:06:25.878221 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":79,"threads_started":1}
I20260808 07:06:25.878901 13380 heartbeater.cc:347] Connected to a master server at 127.29.82.126:41467
I20260808 07:06:25.879002 13380 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:25.879189 13380 heartbeater.cc:511] Master 127.29.82.126:41467 requested a full tablet report, sending...
I20260808 07:06:25.879586 12906 ts_manager.cc:194] Registered new tserver with Master: 9e39c20186924f41b56dc8ddc7675cb2 (127.29.82.66:32989)
I20260808 07:06:25.879954 12906 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:34589
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:06:25.899873 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:41467
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:42057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:25.983556 13388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:25.983781 13388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:25.983814 13388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:25.985009 13388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:25.985054 13388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:25.985090 13388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:06:25.986619 13388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:42057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:41467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:06:25.986866 13388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:25.987087 13388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:25.992172 13398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:25.992199 13393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:25.992192 13394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:25.992422 13388 server_base.cc:1034] running on GCE node
I20260808 07:06:25.992653 13388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:25.992898 13388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:25.994051 13388 hybrid_clock.cc:648] HybridClock initialized: now 1786172785994036 us; error 30 us; skew 500 ppm
Aug 08 07:06:25 dist-test-slave-rmhg krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172785, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:25.996582 13388 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:06:25.997015 13388 webserver.cc:460] Webserver started at http://127.29.82.67:34647/ using document root <none> and password file <none>
I20260808 07:06:25.997253 13388 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:25.997304 13388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:25.997430 13388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:25.998508 13388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d"
format_stamp: "Formatted at 2026-08-08 07:06:25 on dist-test-slave-rmhg"
server_key: "4a02ce5fdca3cc9449b0e48d24702488"
server_key_iv: "fad26e907494d70e77b801c77cf65017"
server_key_version: "encryptionkey@0"
I20260808 07:06:25.998852 13388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d"
format_stamp: "Formatted at 2026-08-08 07:06:25 on dist-test-slave-rmhg"
server_key: "4a02ce5fdca3cc9449b0e48d24702488"
server_key_iv: "fad26e907494d70e77b801c77cf65017"
server_key_version: "encryptionkey@0"
I20260808 07:06:26.000233 13388 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:06:26.000990 13410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:26.001173 13388 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:26.001274 13388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d"
format_stamp: "Formatted at 2026-08-08 07:06:25 on dist-test-slave-rmhg"
server_key: "4a02ce5fdca3cc9449b0e48d24702488"
server_key_iv: "fad26e907494d70e77b801c77cf65017"
server_key_version: "encryptionkey@0"
I20260808 07:06:26.001340 13388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:26.026674 13388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:26.028954 13388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:26.029103 13388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:26.029372 13388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:06:26.029706 13388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:06:26.029742 13388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:26.029770 13388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:06:26.029798 13388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:26.035583 13388 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:34471
I20260808 07:06:26.035626 13577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:34471 every 8 connection(s)
I20260808 07:06:26.035948 13388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:06:26 dist-test-slave-rmhg krb5kdc[12838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172785, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:06:26.044838 12965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.036664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:35541 (local address 127.29.82.126:41467)
0808 07:06:26.036745 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:26.036747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:26.036901 (+ 154us) server_negotiation.cc:407] Connection header received
0808 07:06:26.037489 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:26.037490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:26.037502 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:26.037540 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:26.038496 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.039015 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.040048 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.040254 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.040320 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:26.042561 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:26.042563 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:26.042563 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:26.042570 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:26.043689 (+ 1119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:26.044032 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:26.044033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:26.044033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:26.044091 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:26.044269 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:26.044270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:26.044270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:26.044367 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:26.044413 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:26.044694 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 07:06:26.044771 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 07:06:26.044960 13585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.036618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:41467 (local address 127.29.82.67:35541)
0808 07:06:26.036782 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:26.036825 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:26.037380 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:26.037608 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:26.037612 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:26.038186 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:26.038390 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:26.038395 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.039113 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.039114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:26.039940 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:26.039948 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.040352 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.040353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:26.040468 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:26.041010 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:26.041020 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:26.042471 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:26.043754 (+ 1283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:26.043760 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:26.043762 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:26.043976 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:26.044136 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:26.044136 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:26.044136 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:26.044228 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:26.044408 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:26.044410 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:26.044540 (+ 130us) client_negotiation.cc:769] Sending connection context
0808 07:06:26.044625 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 07:06:26.044766 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
I20260808 07:06:26.045469 13581 heartbeater.cc:347] Connected to a master server at 127.29.82.126:41467
I20260808 07:06:26.045575 13581 heartbeater.cc:464] Registering TS with master...
I20260808 07:06:26.045583 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 13388
I20260808 07:06:26.045704 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:06:26.045776 13581 heartbeater.cc:511] Master 127.29.82.126:41467 requested a full tablet report, sending...
I20260808 07:06:26.045887 30025 external_mini_cluster.cc:1428] Setting key 6028e475f689e6be639acea70e5a0ea2
I20260808 07:06:26.046173 12906 ts_manager.cc:194] Registered new tserver with Master: 7fd79cff0f2a4a83998c5fe2093a5f0d (127.29.82.67:34471)
I20260808 07:06:26.046654 12906 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:35541
I20260808 07:06:26.046733 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:06:26.053143 12965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.047937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56252 (local address 127.29.82.126:41467)
0808 07:06:26.047979 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:26.047981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:26.048101 (+ 120us) server_negotiation.cc:407] Connection header received
0808 07:06:26.048147 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:26.048148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:26.048159 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:26.048214 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:26.048695 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.049211 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.050006 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.050198 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.050247 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:26.051275 (+ 1028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:26.051276 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:26.051276 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:26.051281 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:26.052301 (+ 1020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:26.052569 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:26.052570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:26.052570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:26.052612 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:26.052737 (+ 125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:26.052738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:26.052738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:26.052862 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:26.052929 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:26.053006 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 07:06:26.053061 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:06:26.054662 12906 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56252:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:06:26.056136 12906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:06:26.062860 13602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.058563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39406 (local address 127.29.82.66:32989)
0808 07:06:26.058761 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:26.058766 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:26.059003 (+ 237us) server_negotiation.cc:407] Connection header received
0808 07:06:26.059075 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:26.059078 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:26.059092 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:26.059279 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:26.059538 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.060307 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.061869 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.062376 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.062494 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:26.062544 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:26.062735 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 07:06:26.062780 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":81,"threads_started":1}
I20260808 07:06:26.062851 13604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.058456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:32989 (local address 127.0.0.1:39406)
0808 07:06:26.058930 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:26.058940 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:26.059009 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:26.059363 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:26.059364 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:26.059367 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:26.059425 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:26.059427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.060401 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.060402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:26.061770 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:26.061773 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.062500 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.062501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:26.062584 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:26.062600 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 07:06:26.062707 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 07:06:26.062770 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":33,"thread_start_us":44,"threads_started":1}
I20260808 07:06:26.063629 13287 tablet_service.cc:1467] Processing CreateTablet for tablet baf01a009c4b4234b7d737b38eefde4d (DEFAULT_TABLE table=test-table [id=abfeabaecb434a279006fdee35d2dff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:26.063823 13598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.058646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:34471 (local address 127.0.0.1:43298)
0808 07:06:26.058973 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:26.058981 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:26.059026 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:26.059294 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:26.059295 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:26.059297 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:26.059331 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:26.059332 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.061870 (+ 2538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.061871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:26.062615 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:26.062617 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.063520 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.063521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:26.063665 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:26.063669 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:06:26.063718 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:06:26.063759 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":68,"threads_started":1}
I20260808 07:06:26.064065 13287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf01a009c4b4234b7d737b38eefde4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:26.064090 13601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.058456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:41573 (local address 127.0.0.1:52648)
0808 07:06:26.058613 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:26.058659 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:26.058731 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:26.059139 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:26.059142 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:26.059144 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:26.059221 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:26.059223 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.060571 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.060572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:26.061770 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:26.061773 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.063810 (+ 2037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.063811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:26.063966 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:26.063971 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:06:26.064003 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 07:06:26.064039 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":4,"thread_start_us":94,"threads_started":1}
I20260808 07:06:26.064119 13606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.058757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43298 (local address 127.29.82.67:34471)
0808 07:06:26.058923 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:26.058928 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:26.059081 (+ 153us) server_negotiation.cc:407] Connection header received
0808 07:06:26.059134 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:26.059137 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:26.059152 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:26.059221 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:26.059402 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.060455 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.062714 (+ 2259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.063428 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.063510 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:26.063575 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:26.063992 (+ 417us) server_negotiation.cc:299] Negotiation successful
0808 07:06:26.064041 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
I20260808 07:06:26.064476 13607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.058809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52648 (local address 127.29.82.65:41573)
0808 07:06:26.058979 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:26.058982 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:26.058993 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:06:26.059033 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:26.059035 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:26.059052 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:26.059136 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:26.059298 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.060456 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.062577 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.063722 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.064251 (+ 529us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:26.064325 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:26.064351 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 07:06:26.064392 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":82,"threads_started":1}
I20260808 07:06:26.064754 13482 tablet_service.cc:1467] Processing CreateTablet for tablet baf01a009c4b4234b7d737b38eefde4d (DEFAULT_TABLE table=test-table [id=abfeabaecb434a279006fdee35d2dff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:26.065111 13482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf01a009c4b4234b7d737b38eefde4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:26.065055 13085 tablet_service.cc:1467] Processing CreateTablet for tablet baf01a009c4b4234b7d737b38eefde4d (DEFAULT_TABLE table=test-table [id=abfeabaecb434a279006fdee35d2dff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:06:26.065369 13085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf01a009c4b4234b7d737b38eefde4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:26.067684 13608 tablet_bootstrap.cc:492] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2: Bootstrap starting.
I20260808 07:06:26.068377 13608 tablet_bootstrap.cc:654] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:26.068420 13611 tablet_bootstrap.cc:492] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d: Bootstrap starting.
I20260808 07:06:26.068688 13609 tablet_bootstrap.cc:492] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38: Bootstrap starting.
I20260808 07:06:26.068883 13608 log.cc:824] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:26.069092 13611 tablet_bootstrap.cc:654] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:26.069456 13609 tablet_bootstrap.cc:654] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:26.069747 13611 log.cc:824] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:26.069779 13608 tablet_bootstrap.cc:492] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2: No bootstrap required, opened a new log
I20260808 07:06:26.069906 13608 ts_tablet_manager.cc:1397] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:06:26.070001 13609 log.cc:824] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:26.070673 13609 tablet_bootstrap.cc:492] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38: No bootstrap required, opened a new log
I20260808 07:06:26.070750 13609 ts_tablet_manager.cc:1397] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:06:26.070840 13611 tablet_bootstrap.cc:492] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d: No bootstrap required, opened a new log
I20260808 07:06:26.070906 13611 ts_tablet_manager.cc:1397] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:06:26.071750 13608 raft_consensus.cc:348] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 41573 } } peers { permanent_uuid: "9e39c20186924f41b56dc8ddc7675cb2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32989 } } peers { permanent_uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34471 } }
I20260808 07:06:26.071895 13608 raft_consensus.cc:374] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:26.071929 13608 raft_consensus.cc:729] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e39c20186924f41b56dc8ddc7675cb2, State: Initialized, Role: FOLLOWER
I20260808 07:06:26.072075 13608 consensus_queue.cc:260] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 41573 } } peers { permanent_uuid: "9e39c20186924f41b56dc8ddc7675cb2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32989 } } peers { permanent_uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34471 } }
I20260808 07:06:26.072341 13608 ts_tablet_manager.cc:1428] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:06:26.072470 13380 heartbeater.cc:503] Master 127.29.82.126:41467 was elected leader, sending a full tablet report...
I20260808 07:06:26.072718 13609 raft_consensus.cc:348] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 41573 } } peers { permanent_uuid: "9e39c20186924f41b56dc8ddc7675cb2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32989 } } peers { permanent_uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34471 } }
I20260808 07:06:26.072718 13611 raft_consensus.cc:348] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 41573 } } peers { permanent_uuid: "9e39c20186924f41b56dc8ddc7675cb2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32989 } } peers { permanent_uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34471 } }
I20260808 07:06:26.072885 13609 raft_consensus.cc:374] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:26.072885 13611 raft_consensus.cc:374] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:26.072926 13611 raft_consensus.cc:729] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fd79cff0f2a4a83998c5fe2093a5f0d, State: Initialized, Role: FOLLOWER
I20260808 07:06:26.072926 13609 raft_consensus.cc:729] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0456de8dbe754a2089c34d9c0fcbfd38, State: Initialized, Role: FOLLOWER
I20260808 07:06:26.073063 13609 consensus_queue.cc:260] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 41573 } } peers { permanent_uuid: "9e39c20186924f41b56dc8ddc7675cb2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32989 } } peers { permanent_uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34471 } }
I20260808 07:06:26.073063 13611 consensus_queue.cc:260] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 41573 } } peers { permanent_uuid: "9e39c20186924f41b56dc8ddc7675cb2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32989 } } peers { permanent_uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34471 } }
I20260808 07:06:26.073370 13611 ts_tablet_manager.cc:1428] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:06:26.073370 13609 ts_tablet_manager.cc:1428] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:06:26.073496 13581 heartbeater.cc:503] Master 127.29.82.126:41467 was elected leader, sending a full tablet report...
I20260808 07:06:26.073751 13189 heartbeater.cc:503] Master 127.29.82.126:41467 was elected leader, sending a full tablet report...
W20260808 07:06:26.119410 13381 tablet.cc:2369] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:06:26.195165 13191 tablet.cc:2369] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:06:26.213752 13618 raft_consensus.cc:482] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:06:26.213883 13618 raft_consensus.cc:504] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 41573 } } peers { permanent_uuid: "9e39c20186924f41b56dc8ddc7675cb2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32989 } } peers { permanent_uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34471 } }
I20260808 07:06:26.214202 13618 leader_election.cc:288] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e39c20186924f41b56dc8ddc7675cb2 (127.29.82.66:32989), 7fd79cff0f2a4a83998c5fe2093a5f0d (127.29.82.67:34471)
I20260808 07:06:26.217119 13606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.214460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:37121 (local address 127.29.82.67:34471)
0808 07:06:26.214533 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:26.214537 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:26.214673 (+ 136us) server_negotiation.cc:407] Connection header received
0808 07:06:26.214725 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:26.214726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:26.214736 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:26.214788 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:26.215032 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.215484 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.216426 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.216804 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.216869 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:26.216879 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:26.217009 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 07:06:26.217045 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:06:26.217135 13602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.214511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:37669 (local address 127.29.82.66:32989)
0808 07:06:26.214563 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:26.214565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:26.214629 (+ 64us) server_negotiation.cc:407] Connection header received
0808 07:06:26.214686 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:26.214687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:26.214697 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:26.214748 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:06:26.214907 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.215487 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.216431 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.216803 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.216866 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:26.216877 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:26.217034 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 07:06:26.217071 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:06:26.217200 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.214390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:34471 (local address 127.29.82.65:37121)
0808 07:06:26.214593 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:26.214602 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:26.214672 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:26.214799 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:26.214800 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:26.214802 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:26.214877 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:26.214879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.215562 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.215563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:26.216340 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:26.216342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.216878 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.216879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:26.216946 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:26.216950 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:06:26.216990 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 07:06:26.217030 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":16,"thread_start_us":81,"threads_started":1}
I20260808 07:06:26.217357 13624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.214390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:32989 (local address 127.29.82.65:37669)
0808 07:06:26.214548 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:26.214561 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:26.214628 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:26.214752 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:26.214753 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:26.214755 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:06:26.214845 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:26.214848 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.215569 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.215570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:26.216344 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:26.216346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.216878 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.216879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:26.216960 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:26.216964 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:06:26.217015 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 07:06:26.217051 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":2,"thread_start_us":65,"threads_started":1}
I20260808 07:06:26.217615 13510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf01a009c4b4234b7d737b38eefde4d" candidate_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d" is_pre_election: true
I20260808 07:06:26.217716 13319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf01a009c4b4234b7d737b38eefde4d" candidate_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e39c20186924f41b56dc8ddc7675cb2" is_pre_election: true
I20260808 07:06:26.217788 13510 raft_consensus.cc:2454] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0456de8dbe754a2089c34d9c0fcbfd38 in term 0.
I20260808 07:06:26.217873 13319 raft_consensus.cc:2454] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0456de8dbe754a2089c34d9c0fcbfd38 in term 0.
I20260808 07:06:26.218067 13022 leader_election.cc:302] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0456de8dbe754a2089c34d9c0fcbfd38, 9e39c20186924f41b56dc8ddc7675cb2; no voters:
I20260808 07:06:26.218247 13618 raft_consensus.cc:2781] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:06:26.218287 13618 raft_consensus.cc:482] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:06:26.218302 13618 raft_consensus.cc:3037] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:26.218993 13618 raft_consensus.cc:504] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 41573 } } peers { permanent_uuid: "9e39c20186924f41b56dc8ddc7675cb2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32989 } } peers { permanent_uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34471 } }
I20260808 07:06:26.219115 13618 leader_election.cc:288] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [CANDIDATE]: Term 1 election: Requested vote from peers 9e39c20186924f41b56dc8ddc7675cb2 (127.29.82.66:32989), 7fd79cff0f2a4a83998c5fe2093a5f0d (127.29.82.67:34471)
I20260808 07:06:26.219270 13319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf01a009c4b4234b7d737b38eefde4d" candidate_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e39c20186924f41b56dc8ddc7675cb2"
I20260808 07:06:26.219285 13510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf01a009c4b4234b7d737b38eefde4d" candidate_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d"
I20260808 07:06:26.219355 13319 raft_consensus.cc:3037] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:26.219357 13510 raft_consensus.cc:3037] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:26.220242 13319 raft_consensus.cc:2454] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0456de8dbe754a2089c34d9c0fcbfd38 in term 1.
I20260808 07:06:26.220242 13510 raft_consensus.cc:2454] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0456de8dbe754a2089c34d9c0fcbfd38 in term 1.
I20260808 07:06:26.220440 13023 leader_election.cc:302] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0456de8dbe754a2089c34d9c0fcbfd38, 7fd79cff0f2a4a83998c5fe2093a5f0d; no voters:
I20260808 07:06:26.220556 13618 raft_consensus.cc:2781] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:26.220734 13618 raft_consensus.cc:686] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [term 1 LEADER]: Becoming Leader. State: Replica: 0456de8dbe754a2089c34d9c0fcbfd38, State: Running, Role: LEADER
I20260808 07:06:26.220825 13618 consensus_queue.cc:237] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 41573 } } peers { permanent_uuid: "9e39c20186924f41b56dc8ddc7675cb2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32989 } } peers { permanent_uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34471 } }
I20260808 07:06:26.221689 12906 catalog_manager.cc:5495] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0456de8dbe754a2089c34d9c0fcbfd38 (127.29.82.65). New cstate: current_term: 1 leader_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0456de8dbe754a2089c34d9c0fcbfd38" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 41573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e39c20186924f41b56dc8ddc7675cb2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34471 } health_report { overall_health: UNKNOWN } } }
I20260808 07:06:26.244168 13607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.242041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52656 (local address 127.29.82.65:41573)
0808 07:06:26.242095 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:26.242097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:26.242106 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:06:26.242143 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:26.242144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:26.242162 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:26.242233 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:26.242341 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.242811 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.243542 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:26.243737 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:26.243793 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:26.243896 (+ 103us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:26.244016 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:26.244074 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:26.244090 (+ 16us) server_negotiation.cc:299] Negotiation successful
0808 07:06:26.244107 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:06:26.246003 13319 raft_consensus.cc:1261] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2 [term 1 FOLLOWER]: Refusing update from remote peer 0456de8dbe754a2089c34d9c0fcbfd38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:26.246007 13510 raft_consensus.cc:1261] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d [term 1 FOLLOWER]: Refusing update from remote peer 0456de8dbe754a2089c34d9c0fcbfd38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:26.246361 13625 consensus_queue.cc:1035] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fd79cff0f2a4a83998c5fe2093a5f0d" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 34471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:26.246527 13618 consensus_queue.cc:1035] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e39c20186924f41b56dc8ddc7675cb2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:26.248934 13630 mvcc.cc:205] Tried to move back new op lower bound from 7316163732460847104 to 7316163732361162752. Current Snapshot: MvccSnapshot[applied={T|T < 7316163732460847104}]
I20260808 07:06:26.249248 13632 mvcc.cc:205] Tried to move back new op lower bound from 7316163732460847104 to 7316163732361162752. Current Snapshot: MvccSnapshot[applied={T|T < 7316163732460847104}]
I20260808 07:06:26.249739 13634 mvcc.cc:205] Tried to move back new op lower bound from 7316163732460847104 to 7316163732361162752. Current Snapshot: MvccSnapshot[applied={T|T < 7316163732460847104}]
I20260808 07:06:26.251456 12906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56252:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:06:26.251540 12906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56252:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:06:26.252198 12906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ddb34bd11ba44d82bba535ef6da98e26: Sending DeleteTablet for 3 replicas of tablet baf01a009c4b4234b7d737b38eefde4d
I20260808 07:06:26.252492 13085 tablet_service.cc:1514] Processing DeleteTablet for tablet baf01a009c4b4234b7d737b38eefde4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:26 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:52648
I20260808 07:06:26.252645 13482 tablet_service.cc:1514] Processing DeleteTablet for tablet baf01a009c4b4234b7d737b38eefde4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:26 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:43298
I20260808 07:06:26.252732 13647 tablet_replica.cc:330] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38: stopping tablet replica
I20260808 07:06:26.252833 13647 raft_consensus.cc:2229] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:06:26.252957 13647 raft_consensus.cc:2258] T baf01a009c4b4234b7d737b38eefde4d P 0456de8dbe754a2089c34d9c0fcbfd38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:06:26.252920 13287 tablet_service.cc:1514] Processing DeleteTablet for tablet baf01a009c4b4234b7d737b38eefde4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:06:26 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:39406
I20260808 07:06:26.253036 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 12994
I20260808 07:06:26.261405 13650 tablet_replica.cc:330] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2: stopping tablet replica
I20260808 07:06:26.261487 13649 tablet_replica.cc:330] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d: stopping tablet replica
I20260808 07:06:26.261639 13649 raft_consensus.cc:2229] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:06:26.261659 13650 raft_consensus.cc:2229] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:06:26.261795 13649 raft_consensus.cc:2258] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:06:26.261883 13650 raft_consensus.cc:2258] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:06:26.264747 13649 ts_tablet_manager.cc:1905] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:06:26.266304 13650 ts_tablet_manager.cc:1905] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:06:26.266388 13649 ts_tablet_manager.cc:1918] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:06:26.266461 13649 log.cc:1196] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/baf01a009c4b4234b7d737b38eefde4d
I20260808 07:06:26.266741 13649 ts_tablet_manager.cc:1939] T baf01a009c4b4234b7d737b38eefde4d P 7fd79cff0f2a4a83998c5fe2093a5f0d: Deleting consensus metadata
I20260808 07:06:26.267241 12884 catalog_manager.cc:4841] TS 7fd79cff0f2a4a83998c5fe2093a5f0d (127.29.82.67:34471): tablet baf01a009c4b4234b7d737b38eefde4d (table test-table [id=abfeabaecb434a279006fdee35d2dff2]) successfully deleted
I20260808 07:06:26.267776 13650 ts_tablet_manager.cc:1918] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:06:26.267841 13650 log.cc:1196] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/baf01a009c4b4234b7d737b38eefde4d
I20260808 07:06:26.268059 13650 ts_tablet_manager.cc:1939] T baf01a009c4b4234b7d737b38eefde4d P 9e39c20186924f41b56dc8ddc7675cb2: Deleting consensus metadata
I20260808 07:06:26.268477 12883 catalog_manager.cc:4841] TS 9e39c20186924f41b56dc8ddc7675cb2 (127.29.82.66:32989): tablet baf01a009c4b4234b7d737b38eefde4d (table test-table [id=abfeabaecb434a279006fdee35d2dff2]) successfully deleted
W20260808 07:06:26.268813 12884 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:41573 (error 108)
I20260808 07:06:26.268983 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 13196
I20260808 07:06:26.272437 13598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:26.272281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:41573 (local address 127.0.0.1:52670)
0808 07:06:26.272342 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:26.272396 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:41573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 07:06:26.272563 12884 catalog_manager.cc:4584] TS 0456de8dbe754a2089c34d9c0fcbfd38 (127.29.82.65:41573): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet baf01a009c4b4234b7d737b38eefde4d: Network error: Client connection negotiation failed: client connection to 127.29.82.65:41573: connect: Connection refused (error 111)
I20260808 07:06:26.276952 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 13388
I20260808 07:06:26.289433 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 12858
2026-08-08T07:06:26Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2165 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:26 dist-test-slave-rmhg krb5kdc[13656](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:26 dist-test-slave-rmhg krb5kdc[13656](info): set up 2 sockets
Aug 08 07:06:26 dist-test-slave-rmhg krb5kdc[13656](info): commencing operation
krb5kdc: starting...
W20260808 07:06:27.414494 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:06:27 dist-test-slave-rmhg krb5kdc[13656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:27Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.29.82.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.29.82.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/rangeradmin_127.29.82.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/rangeradmin_127.29.82.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.29.82.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.29.82.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/rangerlookup_127.29.82.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/rangerlookup_127.29.82.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.82.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.29.82.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/HTTP_127.29.82.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/HTTP_127.29.82.84@KRBTEST.COM.keytab.
I20260808 07:06:27.588290 30025 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskZ8Eis0/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/postgres -l logfile start
2026-08-08 07:06:29.945 UTC [13700] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 07:06:29.945 UTC [13700] LOG: listening on IPv4 address "127.29.82.84", port 43753
2026-08-08 07:06:29.949 UTC [13700] LOG: listening on Unix socket "/tmp/.s.PGSQL.43753"
2026-08-08 07:06:29.969 UTC [13704] LOG: database system was shut down at 2026-08-08 07:06:28 UTC
2026-08-08 07:06:29.972 UTC [13700] LOG: database system is ready to accept connections
I20260808 07:06:31.005551 30025 mini_postgres.cc:96] Postgres bound to 43753
2026-08-08 07:06:31.012 UTC [13714] FATAL: database "slave" does not exist
127.29.82.84:43753 - accepting connections
I20260808 07:06:31.013571 30025 mini_ranger.cc:161] Starting Ranger...
I20260808 07:06:31.029230 30025 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 07:06:31.478770 30025 mini_ranger.cc:87] Created ranger Postgres database
I20260808 07:06:31.478840 30025 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-admin
2026-08-08 07:06:31,780 [I] DB FLAVOR :POSTGRES
2026-08-08 07:06:31,780 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 07:06:31,780 [I] Checking connection..
2026-08-08 07:06:31,780 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 07:06:32,051 [I] Checking connection passed.
2026-08-08 07:06:32,051 [I] --------- Verifying version history table ---------
2026-08-08 07:06:32,051 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:06:32,317 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 07:06:32,317 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:06:32,556 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 07:06:32,556 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 07:06:32,556 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 07:06:32.799 UTC [13807] WARNING: there is no transaction in progress
2026-08-08 07:06:32,807 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 07:06:32,807 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:06:33,062 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 07:06:33,063 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 07:06:33,063 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 07:06:33,312 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 07:06:33,585 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-rmhg.c.gcp-upstream.internal','N') ;"
2026-08-08 07:06:33,846 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 07:06:34,108 [I] Table x_portal_user does not exist in database ranger
2026-08-08 07:06:34,109 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 07:06:34,375 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 07:06:34,375 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 07:06:34,648 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 07:06:34,913 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 07:06:34,913 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 07:06:35.897 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:35.914 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:35.930 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:35.945 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:35.963 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:35.980 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:36.033 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:36.039 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:36.052 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:36.062 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:36.072 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:36.085 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:36.095 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:36.101 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:36.107 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:36.113 UTC [13962] WARNING: there is no transaction in progress
2026-08-08 07:06:36,737 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 07:06:36,737 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 07:06:36,997 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 07:06:36,998 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 07:06:37,268 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 07:06:37,268 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 07:06:37,510 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 07:06:37,511 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 07:06:37,781 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 07:06:38,044 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-rmhg.c.gcp-upstream.internal';"
2026-08-08 07:06:38,307 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 07:06:38,308 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 07:06:38,553 [I] DB_PATCHES have already been applied
I20260808 07:06:38.559589 30025 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-admin:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskZ8Eis0/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 07:06:38.559667 30025 mini_ranger.cc:193] Using host: 127.29.82.84
I20260808 07:06:38.563786 30025 mini_ranger.cc:227] Ranger admin URL: http://127.29.82.84:59981
Aug 08, 2026 7:06:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 7:06:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 7:06:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 7:06:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 7:06:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 7:06:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 7:06:39 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 07:06:39.760404 30025 mini_ranger.cc:160] Time spent starting Ranger: real 8.747s user 0.000s sys 0.011s
Aug 08, 2026 7:07:00 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 7:07:00 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 7:07:00 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 7:07:00 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 7:07:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 7:07:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 7:07:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 7:07:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 7:07:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 7:07:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 7:07:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 7:07:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 7:07:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 7:07:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 7:07:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 7:07:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 7:07:00 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 7:07:01 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 07:07:02.261771 30025 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.29.82.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.29.82.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/rangerkms_127.29.82.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/rangerkms_127.29.82.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.82.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.29.82.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.82.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/HTTP_127.29.82.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.82.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/HTTP_127.29.82.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 07:07:02 dist-test-slave-rmhg krb5kdc[13656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172822, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 07:07:02.347391 30025 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 07:07:02.357793 30025 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 07:07:03.231132 30025 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 07:07:03.231204 30025 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-kms
I20260808 07:07:03.231215 30025 mini_ranger_kms.cc:227] Using postgres at 127.29.82.84:43753
2026-08-08 07:07:04,035 [I] DB FLAVOR :POSTGRES
2026-08-08 07:07:04,035 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 07:07:04,035 [I] Checking connection
2026-08-08 07:07:04,036 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 07:07:04,396 [I] connection success
2026-08-08 07:07:04,396 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 07:07:04,396 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 07:07:04,396 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 07:07:04,649 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 07:07:04,649 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 07:07:04,649 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 07:07:04,649 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:43753/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 07:07:04,919 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 07:07:05.397324 30025 mini_ranger_kms.cc:310] Created kms service
I20260808 07:07:05.612604 30025 mini_ranger_kms.cc:326] Created kudu user
I20260808 07:07:05.660926 30025 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 07:07:05 dist-test-slave-rmhg krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172822, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
I20260808 07:07:06.102535 30025 mini_ranger_kms.cc:384] Added ranger policy
I20260808 07:07:06.102661 30025 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-kms:/tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 07:07:06.102681 30025 mini_ranger_kms.cc:240] Using host: 127.29.82.84
I20260808 07:07:06.106799 30025 mini_ranger_kms.cc:276] Ranger KMS PID: 14233
I20260808 07:07:06.106948 30025 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.29.82.84:44821
Aug 08, 2026 7:07:07 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 7:07:07 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 7:07:07 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 7:07:07 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 7:07:07 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 7:07:07 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 07:07:08.506330 30025 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.159s user 0.009s sys 0.452s
I20260808 07:07:08.506429 30025 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 07:07:08.506517 30025 mini_ranger_kms.cc:401] 127.29.82.84:44821/kms/v1/keys
Aug 08 07:07:08 dist-test-slave-rmhg krb5kdc[13656](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172828, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.82.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 07:07:09 dist-test-slave-rmhg krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172828, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.82.84@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
Aug 08 07:07:09 dist-test-slave-rmhg krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172828, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.82.84@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
Aug 08 07:07:12 dist-test-slave-rmhg krb5kdc[13656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:07:12.332562 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:45817
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:45817
--ranger_config_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.82.84:44821/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:12.464251 14308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:12.464640 14308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:12.464687 14308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:12.466079 14308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:12.466130 14308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:12.466144 14308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:12.466156 14308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:12.466167 14308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:12.468199 14308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/wal
--ranger_kms_url=127.29.82.84:44821/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:45817
--ranger_config_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:45817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:07:12.468482 14308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:12.468716 14308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:12.475057 14319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:12.474946 14316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:12.474980 14308 server_base.cc:1034] running on GCE node
W20260808 07:07:12.474959 14317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:12.475540 14308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:12.475860 14308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:12.477038 14308 hybrid_clock.cc:648] HybridClock initialized: now 1786172832477021 us; error 33 us; skew 500 ppm
Aug 08 07:07:12 dist-test-slave-rmhg krb5kdc[13656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172832, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:12.480690 14308 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:07:12.481338 14308 webserver.cc:460] Webserver started at http://127.29.82.126:40479/ using document root <none> and password file <none>
I20260808 07:07:12.481644 14308 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:12.481701 14308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:12.481845 14308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:07:12 dist-test-slave-rmhg krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172832, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
I20260808 07:07:12.540807 14308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "f540f6518c344199ad9dd0467bea47b3"
format_stamp: "Formatted at 2026-08-08 07:07:12 on dist-test-slave-rmhg"
server_key: "0a559b560eaf9fb9a03f1d8891b17678"
server_key_iv: "a5f9b8b2abf97d7820d62d0a2179b1d7"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:12.541302 14308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "f540f6518c344199ad9dd0467bea47b3"
format_stamp: "Formatted at 2026-08-08 07:07:12 on dist-test-slave-rmhg"
server_key: "0a559b560eaf9fb9a03f1d8891b17678"
server_key_iv: "a5f9b8b2abf97d7820d62d0a2179b1d7"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:12.543378 14308 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260808 07:07:12.559501 14328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:12.559775 14308 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:12.559881 14308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "f540f6518c344199ad9dd0467bea47b3"
format_stamp: "Formatted at 2026-08-08 07:07:12 on dist-test-slave-rmhg"
server_key: "0a559b560eaf9fb9a03f1d8891b17678"
server_key_iv: "a5f9b8b2abf97d7820d62d0a2179b1d7"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:12.559986 14308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:12.593969 14308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:12.596256 14308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:12.596439 14308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:12.604702 14308 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:45817
I20260808 07:07:12.604759 14397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:45817 every 8 connection(s)
I20260808 07:07:12.605348 14308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:12.606426 14398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:12.609918 14398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3: Bootstrap starting.
I20260808 07:07:12.610899 14398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:12.611387 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 14308
I20260808 07:07:12.611496 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:07:12.611711 30025 external_mini_cluster.cc:1428] Setting key 207fb17c2485b5938a1537a2bb9b5c52
I20260808 07:07:12.611719 14398 log.cc:824] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:12.612707 14398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3: No bootstrap required, opened a new log
I20260808 07:07:12.615804 14398 raft_consensus.cc:348] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f540f6518c344199ad9dd0467bea47b3" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45817 } }
I20260808 07:07:12.615967 14398 raft_consensus.cc:374] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:12.616000 14398 raft_consensus.cc:729] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f540f6518c344199ad9dd0467bea47b3, State: Initialized, Role: FOLLOWER
I20260808 07:07:12.616182 14398 consensus_queue.cc:260] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f540f6518c344199ad9dd0467bea47b3" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45817 } }
I20260808 07:07:12.616261 14398 raft_consensus.cc:388] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:12.616293 14398 raft_consensus.cc:482] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:12.616358 14398 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:12.617064 14398 raft_consensus.cc:504] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f540f6518c344199ad9dd0467bea47b3" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45817 } }
I20260808 07:07:12.617194 14398 leader_election.cc:302] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f540f6518c344199ad9dd0467bea47b3; no voters:
I20260808 07:07:12.617394 14398 leader_election.cc:288] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:12.617473 14403 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:12.617764 14398 sys_catalog.cc:564] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:12.617841 14403 raft_consensus.cc:686] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [term 1 LEADER]: Becoming Leader. State: Replica: f540f6518c344199ad9dd0467bea47b3, State: Running, Role: LEADER
I20260808 07:07:12.618021 14403 consensus_queue.cc:237] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f540f6518c344199ad9dd0467bea47b3" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45817 } }
I20260808 07:07:12.619975 14404 sys_catalog.cc:455] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f540f6518c344199ad9dd0467bea47b3. Latest consensus state: current_term: 1 leader_uuid: "f540f6518c344199ad9dd0467bea47b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f540f6518c344199ad9dd0467bea47b3" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45817 } } }
I20260808 07:07:12.620066 14404 sys_catalog.cc:458] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:12.620501 14405 sys_catalog.cc:455] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f540f6518c344199ad9dd0467bea47b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f540f6518c344199ad9dd0467bea47b3" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45817 } } }
I20260808 07:07:12.620602 14405 sys_catalog.cc:458] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:12.621213 14425 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:12.621320 14398 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 08 07:07:12 dist-test-slave-rmhg krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:07:12.622099 14425 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:12.630173 14425 catalog_manager.cc:1347] Generated new cluster ID: 1310a6ac029e4efbb05495f974e678e3
I20260808 07:07:12.630257 14425 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:07:12.634130 14402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:12.612361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36594 (local address 127.29.82.126:45817)
0808 07:07:12.612616 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:12.612628 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:12.612715 (+ 87us) server_negotiation.cc:407] Connection header received
0808 07:07:12.613728 (+ 1013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:12.613740 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:12.613816 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:12.613977 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:12.614944 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:12.617239 (+ 2295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:12.618359 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:12.619107 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:12.619225 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:12.622418 (+ 3193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:12.622423 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:12.622423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:12.622438 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:12.627599 (+ 5161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:12.628906 (+ 1307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:12.628911 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:12.628911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:12.629255 (+ 344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:12.629574 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:12.629575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:12.629575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:12.629984 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:12.630204 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:12.633598 (+ 3394us) server_negotiation.cc:299] Negotiation successful
0808 07:07:12.633819 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":93,"threads_started":1}
I20260808 07:07:12.636785 14425 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:12.637408 14425 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:12.642956 14425 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3: Generated new TSK 0
I20260808 07:07:12.643168 14425 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:07:13.596015 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.82.84:44821/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45817
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:13.754256 14466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:13.754601 14466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:13.754648 14466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:13.756614 14466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:13.756680 14466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:13.756724 14466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:07:13.759112 14466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.29.82.84:44821/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:07:13.759413 14466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:13.759761 14466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:13.765595 14475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:13.765625 14481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:13.765552 14477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:13.766114 14466 server_base.cc:1034] running on GCE node
I20260808 07:07:13.766350 14466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:13.766691 14466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:13.767874 14466 hybrid_clock.cc:648] HybridClock initialized: now 1786172833767851 us; error 40 us; skew 500 ppm
Aug 08 07:07:13 dist-test-slave-rmhg krb5kdc[13656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172833, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:13.771806 14466 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:07:13.772256 14466 webserver.cc:460] Webserver started at http://127.29.82.65:33523/ using document root <none> and password file <none>
I20260808 07:07:13.772506 14466 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:13.772567 14466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:13.772698 14466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:07:13 dist-test-slave-rmhg krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172833, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
I20260808 07:07:13.787622 14466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "596928d8e09f4b47ad31d20a17672da8"
format_stamp: "Formatted at 2026-08-08 07:07:13 on dist-test-slave-rmhg"
server_key: "4eada01b38005ba1ffd34892973938e5"
server_key_iv: "31c676d98643945a15317ef6905dc4fc"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:13.788180 14466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "596928d8e09f4b47ad31d20a17672da8"
format_stamp: "Formatted at 2026-08-08 07:07:13 on dist-test-slave-rmhg"
server_key: "4eada01b38005ba1ffd34892973938e5"
server_key_iv: "31c676d98643945a15317ef6905dc4fc"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:13.791028 14466 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 07:07:13.804910 14493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:13.805094 14466 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:13.805217 14466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "596928d8e09f4b47ad31d20a17672da8"
format_stamp: "Formatted at 2026-08-08 07:07:13 on dist-test-slave-rmhg"
server_key: "4eada01b38005ba1ffd34892973938e5"
server_key_iv: "31c676d98643945a15317ef6905dc4fc"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:13.805320 14466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:13.826427 14466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:13.828495 14466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:13.828657 14466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:13.828864 14466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:13.829337 14466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:13.829386 14466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:13.829418 14466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:13.829442 14466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:13.845337 14466 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:37383
I20260808 07:07:13.846338 14656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:37383 every 8 connection(s)
I20260808 07:07:13.846882 14466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:07:13 dist-test-slave-rmhg krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172833, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:07:13.856330 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 14466
I20260808 07:07:13.856434 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:13.856616 30025 external_mini_cluster.cc:1428] Setting key 64878a31122a718bd5f962b8bd1312cf
I20260808 07:07:13.860149 14661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:13.848314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:47713 (local address 127.29.82.126:45817)
0808 07:07:13.848436 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:13.848438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:13.848450 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:07:13.849394 (+ 944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:13.849396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:13.849414 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:13.849488 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:13.850634 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.851435 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.853111 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.853383 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.853436 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:13.856372 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:13.856374 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:13.856375 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:13.856385 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:13.858338 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:13.858907 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:13.858909 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:13.858909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:13.858980 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:13.859294 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:13.859295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:13.859295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:13.859455 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:13.859526 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:13.859929 (+ 403us) server_negotiation.cc:299] Negotiation successful
0808 07:07:13.860030 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":58,"threads_started":1}
I20260808 07:07:13.860420 14660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:13.847886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45817 (local address 127.29.82.65:47713)
0808 07:07:13.848231 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:13.848285 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:13.849264 (+ 979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:13.849587 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:13.849593 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:13.850031 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:13.850503 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:13.850512 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.851546 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.851548 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:13.852992 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:13.852995 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:13.853476 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:13.853477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:13.853698 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:13.854347 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:13.854358 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:13.856250 (+ 1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:13.858455 (+ 2205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:13.858465 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:13.858468 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:13.858814 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:13.859053 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:13.859054 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:13.859054 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:13.859209 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:13.859537 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:13.859545 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:13.859736 (+ 191us) client_negotiation.cc:769] Sending connection context
0808 07:07:13.859894 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 07:07:13.860084 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":188,"threads_started":1}
I20260808 07:07:13.860993 14658 heartbeater.cc:347] Connected to a master server at 127.29.82.126:45817
I20260808 07:07:13.861107 14658 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:13.861346 14658 heartbeater.cc:511] Master 127.29.82.126:45817 requested a full tablet report, sending...
I20260808 07:07:13.861979 14351 ts_manager.cc:194] Registered new tserver with Master: 596928d8e09f4b47ad31d20a17672da8 (127.29.82.65:37383)
I20260808 07:07:13.862861 14351 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:47713
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:07:13.893769 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.82.84:44821/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45817
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:07:14 dist-test-slave-rmhg krb5kdc[13656](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172834, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 07:07:14.036476 14664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:14.036794 14664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:14.036835 14664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:14.038712 14664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:14.038784 14664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:14.038826 14664 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:07:14.041415 14664 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.29.82.84:44821/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:07:14.041697 14664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:14.041998 14664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:14.048506 14673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:14.048931 14681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:14.049507 14664 server_base.cc:1034] running on GCE node
W20260808 07:07:14.049726 14674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:14.049948 14664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:14.050244 14664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:14.051432 14664 hybrid_clock.cc:648] HybridClock initialized: now 1786172834051401 us; error 43 us; skew 500 ppm
Aug 08 07:07:14 dist-test-slave-rmhg krb5kdc[13656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172834, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:14.054957 14664 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:07:14.055546 14664 webserver.cc:460] Webserver started at http://127.29.82.66:45107/ using document root <none> and password file <none>
I20260808 07:07:14.055799 14664 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:14.055853 14664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:14.056002 14664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:07:14 dist-test-slave-rmhg krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172834, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
I20260808 07:07:14.070559 14664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "fc834ae37b714d9b9b59c75b5d167b33"
format_stamp: "Formatted at 2026-08-08 07:07:14 on dist-test-slave-rmhg"
server_key: "7969d8a369efa40fcc56f0fb8e371e64"
server_key_iv: "12374b3fe2ca6909571c7af251f03a37"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:14.070987 14664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "fc834ae37b714d9b9b59c75b5d167b33"
format_stamp: "Formatted at 2026-08-08 07:07:14 on dist-test-slave-rmhg"
server_key: "7969d8a369efa40fcc56f0fb8e371e64"
server_key_iv: "12374b3fe2ca6909571c7af251f03a37"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:14.072732 14664 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260808 07:07:14.096516 14690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:14.096803 14664 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:14.096935 14664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "fc834ae37b714d9b9b59c75b5d167b33"
format_stamp: "Formatted at 2026-08-08 07:07:14 on dist-test-slave-rmhg"
server_key: "7969d8a369efa40fcc56f0fb8e371e64"
server_key_iv: "12374b3fe2ca6909571c7af251f03a37"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:14.097048 14664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:14.115018 14664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:14.117720 14664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:14.117906 14664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:14.118228 14664 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:14.118656 14664 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:14.118707 14664 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:14.118737 14664 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:14.118754 14664 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:14.134793 14664 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:34469
I20260808 07:07:14.134923 14860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:34469 every 8 connection(s)
I20260808 07:07:14.135252 14664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:07:14 dist-test-slave-rmhg krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172834, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:07:14.143226 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 14664
I20260808 07:07:14.143335 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:07:14.143517 30025 external_mini_cluster.cc:1428] Setting key 5343f28943c58e25e67cdad1a41d344e
I20260808 07:07:14.148562 14661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.136316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:44597 (local address 127.29.82.126:45817)
0808 07:07:14.136373 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:14.136375 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:14.136719 (+ 344us) server_negotiation.cc:407] Connection header received
0808 07:07:14.137579 (+ 860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:14.137581 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:14.137599 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:14.137629 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:14.138584 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.139109 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.140347 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.140676 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.140751 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.143768 (+ 3017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:14.143771 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:14.143772 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:14.143781 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:14.145497 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:14.147356 (+ 1859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:14.147359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:14.147359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:14.147431 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:14.147723 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:14.147724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:14.147724 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:14.147873 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:14.147922 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:14.148328 (+ 406us) server_negotiation.cc:299] Negotiation successful
0808 07:07:14.148432 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:07:14.148837 14868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.136311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45817 (local address 127.29.82.66:44597)
0808 07:07:14.136551 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:14.136598 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:14.137431 (+ 833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:14.137792 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:14.137796 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:14.138122 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:14.138389 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:14.138395 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.139201 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.139202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:14.140255 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:14.140258 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.140831 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.140832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:14.141002 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.141609 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:14.141619 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:14.142987 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:14.146854 (+ 3867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:14.146866 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:14.146870 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:14.147255 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:14.147500 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:14.147500 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:14.147501 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:14.147653 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:14.147978 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:14.147987 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:14.148188 (+ 201us) client_negotiation.cc:769] Sending connection context
0808 07:07:14.148291 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 07:07:14.148461 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":113,"threads_started":1}
I20260808 07:07:14.149377 14864 heartbeater.cc:347] Connected to a master server at 127.29.82.126:45817
I20260808 07:07:14.149480 14864 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:14.149677 14864 heartbeater.cc:511] Master 127.29.82.126:45817 requested a full tablet report, sending...
I20260808 07:07:14.150091 14351 ts_manager.cc:194] Registered new tserver with Master: fc834ae37b714d9b9b59c75b5d167b33 (127.29.82.66:34469)
I20260808 07:07:14.150471 14351 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:44597
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:07:14.179474 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.82.84:44821/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45817
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:14.307189 14871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:14.307415 14871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:14.307440 14871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:14.308701 14871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:14.308751 14871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:14.308779 14871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:07:14.310977 14871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.29.82.84:44821/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:45817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:07:14.311264 14871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:14.311568 14871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:14.319355 14877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:14.319356 14876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:14.320539 14871 server_base.cc:1034] running on GCE node
W20260808 07:07:14.323376 14879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:14.323760 14871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:14.324079 14871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:14.325228 14871 hybrid_clock.cc:648] HybridClock initialized: now 1786172834325208 us; error 37 us; skew 500 ppm
Aug 08 07:07:14 dist-test-slave-rmhg krb5kdc[13656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172834, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:14.328603 14871 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:07:14.329241 14871 webserver.cc:460] Webserver started at http://127.29.82.67:44991/ using document root <none> and password file <none>
I20260808 07:07:14.329526 14871 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:14.329604 14871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:14.329754 14871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:07:14 dist-test-slave-rmhg krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172834, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
I20260808 07:07:14.344100 14871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "c525a542c3dc484fa1e3b70cc6e9498c"
format_stamp: "Formatted at 2026-08-08 07:07:14 on dist-test-slave-rmhg"
server_key: "740fe3ed6a05e6313dc7f8c262634c42"
server_key_iv: "996229ed82c87f91cf2c24bf19ff883e"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:14.344815 14871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "c525a542c3dc484fa1e3b70cc6e9498c"
format_stamp: "Formatted at 2026-08-08 07:07:14 on dist-test-slave-rmhg"
server_key: "740fe3ed6a05e6313dc7f8c262634c42"
server_key_iv: "996229ed82c87f91cf2c24bf19ff883e"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:14.349637 14871 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.002s
I20260808 07:07:14.371870 14889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:14.372113 14871 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.000s sys 0.000s
I20260808 07:07:14.372227 14871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "c525a542c3dc484fa1e3b70cc6e9498c"
format_stamp: "Formatted at 2026-08-08 07:07:14 on dist-test-slave-rmhg"
server_key: "740fe3ed6a05e6313dc7f8c262634c42"
server_key_iv: "996229ed82c87f91cf2c24bf19ff883e"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:14.372337 14871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:14.393849 14871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:14.395830 14871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:14.395975 14871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:14.396240 14871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:14.396633 14871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:14.396678 14871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:14.396709 14871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:14.396730 14871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:14.409510 14871 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:41815
I20260808 07:07:14.409786 15060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:41815 every 8 connection(s)
I20260808 07:07:14.410122 14871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:07:14.417088 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 14871
I20260808 07:07:14.417243 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:07:14.417451 30025 external_mini_cluster.cc:1428] Setting key 5e25c9c7402fcc1b17edd2e848496668
Aug 08 07:07:14 dist-test-slave-rmhg krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172834, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:07:14.421881 14661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.411100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:50475 (local address 127.29.82.126:45817)
0808 07:07:14.411158 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:14.411162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:14.411552 (+ 390us) server_negotiation.cc:407] Connection header received
0808 07:07:14.412372 (+ 820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:14.412373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:14.412385 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:14.412430 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:14.413561 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.414066 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.415699 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.415915 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.415962 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.418930 (+ 2968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:14.418932 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:14.418932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:14.418941 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:14.420361 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:14.420864 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:14.420865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:14.420865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:14.420913 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:14.421228 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:14.421229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:14.421229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:14.421344 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:14.421393 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:14.421746 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 07:07:14.421812 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:07:14.422237 15063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.411059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45817 (local address 127.29.82.67:50475)
0808 07:07:14.411351 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:14.411405 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:14.412254 (+ 849us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:14.412519 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:14.412523 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:14.412933 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:14.413471 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:14.413480 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.414159 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.414161 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:14.415615 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:14.415618 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.415980 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.415981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:14.416174 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.416742 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:14.416755 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:14.418803 (+ 2048us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:14.420438 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:14.420453 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:14.420456 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:14.420796 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:14.420966 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:14.420967 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:14.420967 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:14.421124 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:14.421402 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:14.421408 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:14.421611 (+ 203us) client_negotiation.cc:769] Sending connection context
0808 07:07:14.421732 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 07:07:14.421918 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":167,"threads_started":1}
I20260808 07:07:14.422837 15061 heartbeater.cc:347] Connected to a master server at 127.29.82.126:45817
I20260808 07:07:14.422962 15061 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:14.423192 15061 heartbeater.cc:511] Master 127.29.82.126:45817 requested a full tablet report, sending...
I20260808 07:07:14.423597 14351 ts_manager.cc:194] Registered new tserver with Master: c525a542c3dc484fa1e3b70cc6e9498c (127.29.82.67:41815)
I20260808 07:07:14.424122 14351 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:50475
I20260808 07:07:14.429739 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:07:14.437536 14661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.431327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36606 (local address 127.29.82.126:45817)
0808 07:07:14.431370 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:14.431373 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:14.431543 (+ 170us) server_negotiation.cc:407] Connection header received
0808 07:07:14.431613 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:14.431615 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:14.431626 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:14.431675 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:14.432331 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.432833 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.433598 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.433800 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.433852 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.435078 (+ 1226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:14.435079 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:14.435080 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:14.435088 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:14.436431 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:14.436756 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:14.436757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:14.436758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:14.436818 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:14.436980 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:14.436981 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:14.436981 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:14.437098 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:14.437213 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:14.437357 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 07:07:14.437439 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:07:14.439280 14351 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36606:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:07:14.441111 14351 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:07:14.449749 15075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.444007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:34469 (local address 127.0.0.1:59652)
0808 07:07:14.444720 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:14.444732 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:14.444802 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:14.445189 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:14.445193 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:14.445197 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:14.445280 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:14.445282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.447009 (+ 1727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.447010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:14.448296 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:14.448299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.449437 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.449438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:14.449528 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.449544 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 07:07:14.449588 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:07:14.449656 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"mutex_wait_us":32,"thread_start_us":352,"threads_started":1}
I20260808 07:07:14.450515 15078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.444275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59652 (local address 127.29.82.66:34469)
0808 07:07:14.444961 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:14.444967 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:14.444977 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:07:14.445043 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:14.445046 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:14.445064 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:14.445173 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:14.445366 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.446600 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.448461 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.449339 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.450205 (+ 866us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.450361 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:14.450389 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 07:07:14.450431 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":123,"threads_started":1}
I20260808 07:07:14.450549 15076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.444112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52232 (local address 127.29.82.65:37383)
0808 07:07:14.445334 (+ 1222us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:14.445339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:14.445349 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:07:14.445382 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:14.445384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:14.445400 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:14.445472 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:14.445661 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.446853 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.449228 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.450065 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.450128 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.450195 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:14.450419 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 07:07:14.450470 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1185,"thread_start_us":64,"threads_started":1}
I20260808 07:07:14.450762 15077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.444001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:37383 (local address 127.0.0.1:52232)
0808 07:07:14.444636 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:14.444686 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:14.445106 (+ 420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:14.445473 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:14.445474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:14.445476 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:14.445555 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:14.445557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.446956 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.446956 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:14.449087 (+ 2131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:14.449091 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.450260 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.450261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:14.450325 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.450328 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:14.450638 (+ 310us) client_negotiation.cc:240] Negotiation successful
0808 07:07:14.450685 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"mutex_wait_us":1,"thread_start_us":176,"threads_started":1}
I20260808 07:07:14.451598 14765 tablet_service.cc:1467] Processing CreateTablet for tablet bd4536de5e6345a28fea9a3abad3a6d3 (DEFAULT_TABLE table=test-table [id=827a7080ba42411ea2e5aa7569eab6cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:14.452059 14765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd4536de5e6345a28fea9a3abad3a6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:14.456207 15082 tablet_bootstrap.cc:492] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33: Bootstrap starting.
I20260808 07:07:14.457331 14537 tablet_service.cc:1467] Processing CreateTablet for tablet bd4536de5e6345a28fea9a3abad3a6d3 (DEFAULT_TABLE table=test-table [id=827a7080ba42411ea2e5aa7569eab6cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:14.457742 14537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd4536de5e6345a28fea9a3abad3a6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:14.462240 15083 tablet_bootstrap.cc:492] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8: Bootstrap starting.
I20260808 07:07:14.463559 15083 tablet_bootstrap.cc:654] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:14.464404 15083 log.cc:824] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:14.465490 15083 tablet_bootstrap.cc:492] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8: No bootstrap required, opened a new log
I20260808 07:07:14.465591 15083 ts_tablet_manager.cc:1397] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:07:14.469974 15083 raft_consensus.cc:348] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc834ae37b714d9b9b59c75b5d167b33" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 34469 } } peers { permanent_uuid: "596928d8e09f4b47ad31d20a17672da8" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37383 } } peers { permanent_uuid: "c525a542c3dc484fa1e3b70cc6e9498c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 41815 } }
I20260808 07:07:14.470182 15083 raft_consensus.cc:374] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:14.470232 15083 raft_consensus.cc:729] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 596928d8e09f4b47ad31d20a17672da8, State: Initialized, Role: FOLLOWER
I20260808 07:07:14.470382 15081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.444651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56938 (local address 127.29.82.67:41815)
0808 07:07:14.445017 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:14.445022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:14.445719 (+ 697us) server_negotiation.cc:407] Connection header received
0808 07:07:14.445788 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:14.445791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:14.445809 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:14.445879 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:14.446129 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.447333 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.466185 (+ 18852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.467255 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.467343 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.467495 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:14.470180 (+ 2685us) server_negotiation.cc:299] Negotiation successful
0808 07:07:14.470241 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":123,"threads_started":1}
I20260808 07:07:14.470419 15083 consensus_queue.cc:260] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc834ae37b714d9b9b59c75b5d167b33" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 34469 } } peers { permanent_uuid: "596928d8e09f4b47ad31d20a17672da8" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37383 } } peers { permanent_uuid: "c525a542c3dc484fa1e3b70cc6e9498c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 41815 } }
I20260808 07:07:14.470654 15079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.444497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:41815 (local address 127.0.0.1:56938)
0808 07:07:14.445607 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:14.445618 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:14.445665 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:14.445998 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:14.445998 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:14.446001 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:14.446042 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:14.446044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.447419 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.447420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:14.465998 (+ 18578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:14.466005 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.469947 (+ 3942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.469949 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:14.470035 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.470042 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 07:07:14.470507 (+ 465us) client_negotiation.cc:240] Negotiation successful
0808 07:07:14.470574 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1076,"thread_start_us":126,"threads_started":1}
I20260808 07:07:14.470783 15083 ts_tablet_manager.cc:1428] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260808 07:07:14.470899 14658 heartbeater.cc:503] Master 127.29.82.126:45817 was elected leader, sending a full tablet report...
I20260808 07:07:14.471804 15082 tablet_bootstrap.cc:654] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:14.472699 14954 tablet_service.cc:1467] Processing CreateTablet for tablet bd4536de5e6345a28fea9a3abad3a6d3 (DEFAULT_TABLE table=test-table [id=827a7080ba42411ea2e5aa7569eab6cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:07:14.473215 14954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd4536de5e6345a28fea9a3abad3a6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:14.474671 15082 log.cc:824] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:14.477952 15089 tablet_bootstrap.cc:492] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c: Bootstrap starting.
I20260808 07:07:14.478876 15082 tablet_bootstrap.cc:492] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33: No bootstrap required, opened a new log
I20260808 07:07:14.479010 15082 ts_tablet_manager.cc:1397] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260808 07:07:14.480290 15089 tablet_bootstrap.cc:654] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:14.480877 15089 log.cc:824] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:14.482465 15082 raft_consensus.cc:348] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc834ae37b714d9b9b59c75b5d167b33" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 34469 } } peers { permanent_uuid: "596928d8e09f4b47ad31d20a17672da8" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37383 } } peers { permanent_uuid: "c525a542c3dc484fa1e3b70cc6e9498c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 41815 } }
I20260808 07:07:14.482674 15082 raft_consensus.cc:374] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:14.482715 15082 raft_consensus.cc:729] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc834ae37b714d9b9b59c75b5d167b33, State: Initialized, Role: FOLLOWER
I20260808 07:07:14.482887 15082 consensus_queue.cc:260] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc834ae37b714d9b9b59c75b5d167b33" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 34469 } } peers { permanent_uuid: "596928d8e09f4b47ad31d20a17672da8" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37383 } } peers { permanent_uuid: "c525a542c3dc484fa1e3b70cc6e9498c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 41815 } }
I20260808 07:07:14.483212 15082 ts_tablet_manager.cc:1428] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260808 07:07:14.483345 14864 heartbeater.cc:503] Master 127.29.82.126:45817 was elected leader, sending a full tablet report...
I20260808 07:07:14.485435 15089 tablet_bootstrap.cc:492] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c: No bootstrap required, opened a new log
I20260808 07:07:14.485519 15089 ts_tablet_manager.cc:1397] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260808 07:07:14.488299 15089 raft_consensus.cc:348] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc834ae37b714d9b9b59c75b5d167b33" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 34469 } } peers { permanent_uuid: "596928d8e09f4b47ad31d20a17672da8" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37383 } } peers { permanent_uuid: "c525a542c3dc484fa1e3b70cc6e9498c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 41815 } }
I20260808 07:07:14.488448 15089 raft_consensus.cc:374] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:14.488479 15089 raft_consensus.cc:729] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c525a542c3dc484fa1e3b70cc6e9498c, State: Initialized, Role: FOLLOWER
I20260808 07:07:14.488621 15089 consensus_queue.cc:260] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc834ae37b714d9b9b59c75b5d167b33" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 34469 } } peers { permanent_uuid: "596928d8e09f4b47ad31d20a17672da8" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37383 } } peers { permanent_uuid: "c525a542c3dc484fa1e3b70cc6e9498c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 41815 } }
I20260808 07:07:14.488973 15089 ts_tablet_manager.cc:1428] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260808 07:07:14.489089 15061 heartbeater.cc:503] Master 127.29.82.126:45817 was elected leader, sending a full tablet report...
I20260808 07:07:14.490777 15086 raft_consensus.cc:482] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:07:14.490931 15086 raft_consensus.cc:504] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc834ae37b714d9b9b59c75b5d167b33" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 34469 } } peers { permanent_uuid: "596928d8e09f4b47ad31d20a17672da8" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37383 } } peers { permanent_uuid: "c525a542c3dc484fa1e3b70cc6e9498c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 41815 } }
I20260808 07:07:14.491346 15086 leader_election.cc:288] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc834ae37b714d9b9b59c75b5d167b33 (127.29.82.66:34469), c525a542c3dc484fa1e3b70cc6e9498c (127.29.82.67:41815)
I20260808 07:07:14.496196 15078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.492060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:53657 (local address 127.29.82.66:34469)
0808 07:07:14.492122 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:14.492125 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:14.492137 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:07:14.492164 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:14.492166 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:14.492179 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:14.492251 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:14.492556 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.493390 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.495166 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.495724 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.495780 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.495792 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:14.496070 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 07:07:14.496120 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:07:14.496212 15081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.492135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:51665 (local address 127.29.82.67:41815)
0808 07:07:14.492170 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:14.492172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:14.492364 (+ 192us) server_negotiation.cc:407] Connection header received
0808 07:07:14.492465 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:14.492466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:14.492474 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:14.492502 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:07:14.492857 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.493588 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.495166 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.495727 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.495844 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.495852 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:14.496120 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 07:07:14.496159 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:07:14.496541 15093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.491578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:34469 (local address 127.29.82.65:53657)
0808 07:07:14.491868 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:14.491881 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:14.491939 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:14.492259 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:14.492262 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:14.492309 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:14.492469 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:14.492472 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.493565 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.493566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:14.495073 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:14.495074 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.495853 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.495854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:14.495975 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.495978 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:14.496328 (+ 350us) client_negotiation.cc:240] Negotiation successful
0808 07:07:14.496381 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":8,"thread_start_us":144,"threads_started":1}
I20260808 07:07:14.496963 15094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.491851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:41815 (local address 127.29.82.65:51665)
0808 07:07:14.492301 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:14.492311 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:14.492397 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:14.492571 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:14.492572 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:14.492573 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:07:14.492769 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:14.492771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.493769 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.493769 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:14.495032 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:14.495036 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.495902 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.495903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:14.496029 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.496032 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:07:14.496581 (+ 549us) client_negotiation.cc:240] Negotiation successful
0808 07:07:14.496858 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":26,"thread_start_us":110,"threads_started":1}
I20260808 07:07:14.497080 14793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd4536de5e6345a28fea9a3abad3a6d3" candidate_uuid: "596928d8e09f4b47ad31d20a17672da8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc834ae37b714d9b9b59c75b5d167b33" is_pre_election: true
I20260808 07:07:14.497275 14793 raft_consensus.cc:2454] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 596928d8e09f4b47ad31d20a17672da8 in term 0.
I20260808 07:07:14.497566 14956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd4536de5e6345a28fea9a3abad3a6d3" candidate_uuid: "596928d8e09f4b47ad31d20a17672da8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c525a542c3dc484fa1e3b70cc6e9498c" is_pre_election: true
I20260808 07:07:14.497653 14494 leader_election.cc:302] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 596928d8e09f4b47ad31d20a17672da8, fc834ae37b714d9b9b59c75b5d167b33; no voters:
I20260808 07:07:14.497740 14956 raft_consensus.cc:2454] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 596928d8e09f4b47ad31d20a17672da8 in term 0.
I20260808 07:07:14.497807 15086 raft_consensus.cc:2781] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:07:14.497857 15086 raft_consensus.cc:482] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:07:14.497881 15086 raft_consensus.cc:3037] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:14.498894 15086 raft_consensus.cc:504] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc834ae37b714d9b9b59c75b5d167b33" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 34469 } } peers { permanent_uuid: "596928d8e09f4b47ad31d20a17672da8" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37383 } } peers { permanent_uuid: "c525a542c3dc484fa1e3b70cc6e9498c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 41815 } }
I20260808 07:07:14.499019 15086 leader_election.cc:288] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [CANDIDATE]: Term 1 election: Requested vote from peers fc834ae37b714d9b9b59c75b5d167b33 (127.29.82.66:34469), c525a542c3dc484fa1e3b70cc6e9498c (127.29.82.67:41815)
I20260808 07:07:14.499320 14793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd4536de5e6345a28fea9a3abad3a6d3" candidate_uuid: "596928d8e09f4b47ad31d20a17672da8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc834ae37b714d9b9b59c75b5d167b33"
I20260808 07:07:14.499361 14956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd4536de5e6345a28fea9a3abad3a6d3" candidate_uuid: "596928d8e09f4b47ad31d20a17672da8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c525a542c3dc484fa1e3b70cc6e9498c"
I20260808 07:07:14.499408 14793 raft_consensus.cc:3037] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:14.499423 14956 raft_consensus.cc:3037] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:14.500484 14956 raft_consensus.cc:2454] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 596928d8e09f4b47ad31d20a17672da8 in term 1.
I20260808 07:07:14.500728 14494 leader_election.cc:302] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 596928d8e09f4b47ad31d20a17672da8, c525a542c3dc484fa1e3b70cc6e9498c; no voters:
I20260808 07:07:14.500828 14793 raft_consensus.cc:2454] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 596928d8e09f4b47ad31d20a17672da8 in term 1.
I20260808 07:07:14.500986 15086 raft_consensus.cc:2781] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:14.501173 15086 raft_consensus.cc:686] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [term 1 LEADER]: Becoming Leader. State: Replica: 596928d8e09f4b47ad31d20a17672da8, State: Running, Role: LEADER
I20260808 07:07:14.501279 15086 consensus_queue.cc:237] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc834ae37b714d9b9b59c75b5d167b33" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 34469 } } peers { permanent_uuid: "596928d8e09f4b47ad31d20a17672da8" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37383 } } peers { permanent_uuid: "c525a542c3dc484fa1e3b70cc6e9498c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 41815 } }
I20260808 07:07:14.502166 14351 catalog_manager.cc:5495] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 596928d8e09f4b47ad31d20a17672da8 (127.29.82.65). New cstate: current_term: 1 leader_uuid: "596928d8e09f4b47ad31d20a17672da8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc834ae37b714d9b9b59c75b5d167b33" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 34469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "596928d8e09f4b47ad31d20a17672da8" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 37383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c525a542c3dc484fa1e3b70cc6e9498c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 41815 } health_report { overall_health: UNKNOWN } } }
I20260808 07:07:14.516185 15076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.513128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52244 (local address 127.29.82.65:37383)
0808 07:07:14.513207 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:14.513209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:14.513259 (+ 50us) server_negotiation.cc:407] Connection header received
0808 07:07:14.513322 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:14.513323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:14.513344 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:14.513409 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:07:14.513596 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.514259 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.515185 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:14.515417 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:14.515480 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:14.515754 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:07:14.515868 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:07:14.515953 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:14.515969 (+ 16us) server_negotiation.cc:299] Negotiation successful
0808 07:07:14.515993 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 07:07:14.518586 14956 raft_consensus.cc:1261] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c [term 1 FOLLOWER]: Refusing update from remote peer 596928d8e09f4b47ad31d20a17672da8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:14.518635 14793 raft_consensus.cc:1261] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33 [term 1 FOLLOWER]: Refusing update from remote peer 596928d8e09f4b47ad31d20a17672da8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:07:14.519088 15086 consensus_queue.cc:1035] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c525a542c3dc484fa1e3b70cc6e9498c" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 41815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:14.519359 15095 consensus_queue.cc:1035] T bd4536de5e6345a28fea9a3abad3a6d3 P 596928d8e09f4b47ad31d20a17672da8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc834ae37b714d9b9b59c75b5d167b33" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 34469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:07:14.523855 15106 mvcc.cc:205] Tried to move back new op lower bound from 7316163930185314304 to 7316163930117849088. Current Snapshot: MvccSnapshot[applied={T|T < 7316163930185314304}]
I20260808 07:07:14.524034 15101 mvcc.cc:205] Tried to move back new op lower bound from 7316163930185314304 to 7316163930117849088. Current Snapshot: MvccSnapshot[applied={T|T < 7316163930185314304}]
I20260808 07:07:14.525596 15110 mvcc.cc:205] Tried to move back new op lower bound from 7316163930185314304 to 7316163930117849088. Current Snapshot: MvccSnapshot[applied={T|T < 7316163930185314304}]
I20260808 07:07:14.528566 14349 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:14.528676 14349 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:07:14.529549 14349 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f540f6518c344199ad9dd0467bea47b3: Sending DeleteTablet for 3 replicas of tablet bd4536de5e6345a28fea9a3abad3a6d3
I20260808 07:07:14.530112 14765 tablet_service.cc:1514] Processing DeleteTablet for tablet bd4536de5e6345a28fea9a3abad3a6d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:14 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:59652
I20260808 07:07:14.530237 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 14466
I20260808 07:07:14.530515 14954 tablet_service.cc:1514] Processing DeleteTablet for tablet bd4536de5e6345a28fea9a3abad3a6d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:07:14 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:56938
I20260808 07:07:14.532723 15121 tablet_replica.cc:330] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33: stopping tablet replica
I20260808 07:07:14.532850 15121 raft_consensus.cc:2229] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:14.532965 15121 raft_consensus.cc:2258] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:14.533224 15122 tablet_replica.cc:330] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c: stopping tablet replica
I20260808 07:07:14.533329 15122 raft_consensus.cc:2229] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:07:14.533423 15122 raft_consensus.cc:2258] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:07:14.533939 15122 ts_tablet_manager.cc:1905] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:14.536556 15121 ts_tablet_manager.cc:1905] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:07:14.538729 15121 ts_tablet_manager.cc:1918] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:07:14.538821 15121 log.cc:1196] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/bd4536de5e6345a28fea9a3abad3a6d3
I20260808 07:07:14.539510 15121 ts_tablet_manager.cc:1939] T bd4536de5e6345a28fea9a3abad3a6d3 P fc834ae37b714d9b9b59c75b5d167b33: Deleting consensus metadata
I20260808 07:07:14.539984 14329 catalog_manager.cc:4841] TS fc834ae37b714d9b9b59c75b5d167b33 (127.29.82.66:34469): tablet bd4536de5e6345a28fea9a3abad3a6d3 (table test-table [id=827a7080ba42411ea2e5aa7569eab6cb]) successfully deleted
I20260808 07:07:14.544467 15122 ts_tablet_manager.cc:1918] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260808 07:07:14.544560 14332 connection.cc:535] client connection to 127.29.82.65:37383 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 07:07:14.544658 14332 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:07:14.544664 15122 log.cc:1196] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/bd4536de5e6345a28fea9a3abad3a6d3
I20260808 07:07:14.545363 15122 ts_tablet_manager.cc:1939] T bd4536de5e6345a28fea9a3abad3a6d3 P c525a542c3dc484fa1e3b70cc6e9498c: Deleting consensus metadata
I20260808 07:07:14.545393 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 14664
I20260808 07:07:14.560379 15079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:14.560239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:37383 (local address 127.0.0.1:52260)
0808 07:07:14.560300 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:14.560335 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:37383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 07:07:14.560658 14332 catalog_manager.cc:4584] TS 596928d8e09f4b47ad31d20a17672da8 (127.29.82.65:37383): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bd4536de5e6345a28fea9a3abad3a6d3: Network error: Client connection negotiation failed: client connection to 127.29.82.65:37383: connect: Connection refused (error 111)
I20260808 07:07:14.566279 14329 catalog_manager.cc:4841] TS c525a542c3dc484fa1e3b70cc6e9498c (127.29.82.67:41815): tablet bd4536de5e6345a28fea9a3abad3a6d3 (table test-table [id=827a7080ba42411ea2e5aa7569eab6cb]) successfully deleted
I20260808 07:07:14.572929 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 14871
I20260808 07:07:14.592059 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 14308
I20260808 07:07:14.605495 30025 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 07:07:14.950527 30025 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 07:07:14.950672 30025 mini_ranger.cc:66] Stopping Ranger...
I20260808 07:07:15.295248 30025 mini_ranger.cc:68] Stopped Ranger
2026-08-08 07:07:15.295 UTC [13700] LOG: received smart shutdown request
2026-08-08 07:07:15.299 UTC [13700] LOG: background worker "logical replication launcher" (PID 13712) exited with exit code 1
2026-08-08 07:07:15.299 UTC [13705] LOG: shutting down
2026-08-08 07:07:15.461 UTC [13700] LOG: database system is shut down
2026-08-08T07:07:15Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49257 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:07:15 dist-test-slave-rmhg krb5kdc[15134](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:07:15 dist-test-slave-rmhg krb5kdc[15134](info): set up 2 sockets
Aug 08 07:07:15 dist-test-slave-rmhg krb5kdc[15134](info): commencing operation
krb5kdc: starting...
W20260808 07:07:16.692262 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:07:16 dist-test-slave-rmhg krb5kdc[15134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:07:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:07:16Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.29.82.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.29.82.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/rangeradmin_127.29.82.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/rangeradmin_127.29.82.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.29.82.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.29.82.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/rangerlookup_127.29.82.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/rangerlookup_127.29.82.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.82.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.29.82.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/HTTP_127.29.82.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/HTTP_127.29.82.84@KRBTEST.COM.keytab.
I20260808 07:07:16.865856 30025 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskZ8Eis0/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/postgres -l logfile start
2026-08-08 07:07:19.229 UTC [15180] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 07:07:19.229 UTC [15180] LOG: listening on IPv4 address "127.29.82.84", port 60091
2026-08-08 07:07:19.233 UTC [15180] LOG: listening on Unix socket "/tmp/.s.PGSQL.60091"
2026-08-08 07:07:19.253 UTC [15184] LOG: database system was shut down at 2026-08-08 07:07:17 UTC
2026-08-08 07:07:19.256 UTC [15180] LOG: database system is ready to accept connections
I20260808 07:07:20.295759 30025 mini_postgres.cc:96] Postgres bound to 60091
2026-08-08 07:07:20.302 UTC [15194] FATAL: database "slave" does not exist
127.29.82.84:60091 - accepting connections
I20260808 07:07:20.303277 30025 mini_ranger.cc:161] Starting Ranger...
I20260808 07:07:20.318331 30025 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 07:07:20.743404 30025 mini_ranger.cc:87] Created ranger Postgres database
I20260808 07:07:20.743492 30025 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-admin
2026-08-08 07:07:21,017 [I] DB FLAVOR :POSTGRES
2026-08-08 07:07:21,018 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 07:07:21,018 [I] Checking connection..
2026-08-08 07:07:21,018 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 07:07:21,288 [I] Checking connection passed.
2026-08-08 07:07:21,288 [I] --------- Verifying version history table ---------
2026-08-08 07:07:21,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:07:21,549 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 07:07:21,549 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:07:21,820 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 07:07:21,820 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 07:07:21,820 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 07:07:22.079 UTC [15285] WARNING: there is no transaction in progress
2026-08-08 07:07:22,088 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 07:07:22,088 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:07:22,360 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 07:07:22,360 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 07:07:22,360 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 07:07:22,631 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 07:07:22,881 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-rmhg.c.gcp-upstream.internal','N') ;"
2026-08-08 07:07:23,134 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 07:07:23,394 [I] Table x_portal_user does not exist in database ranger
2026-08-08 07:07:23,394 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 07:07:23,662 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 07:07:23,663 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 07:07:23,928 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 07:07:24,180 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 07:07:24,180 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 07:07:25.150 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.167 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.183 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.198 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.214 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.230 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.284 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.290 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.304 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.313 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.323 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.335 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.344 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.350 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.356 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25.362 UTC [15442] WARNING: there is no transaction in progress
2026-08-08 07:07:25,971 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 07:07:25,971 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 07:07:26,234 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 07:07:26,234 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 07:07:26,487 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 07:07:26,488 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 07:07:26,759 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 07:07:26,759 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 07:07:27,024 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 07:07:27,262 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-rmhg.c.gcp-upstream.internal';"
2026-08-08 07:07:27,501 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 07:07:27,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 07:07:27,749 [I] DB_PATCHES have already been applied
I20260808 07:07:27.755412 30025 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-admin:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskZ8Eis0/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 07:07:27.755539 30025 mini_ranger.cc:193] Using host: 127.29.82.84
I20260808 07:07:27.760080 30025 mini_ranger.cc:227] Ranger admin URL: http://127.29.82.84:41993
Aug 08, 2026 7:07:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 7:07:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 7:07:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 7:07:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 7:07:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 7:07:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 7:07:28 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 07:07:28.992738 30025 mini_ranger.cc:160] Time spent starting Ranger: real 8.689s user 0.000s sys 0.011s
Aug 08, 2026 7:07:48 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 7:07:48 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 7:07:48 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 7:07:48 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 7:07:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 7:07:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 7:07:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 7:07:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 7:07:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 7:07:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 7:07:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 7:07:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 7:07:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 7:07:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 7:07:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 7:07:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 7:07:48 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 7:07:49 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 07:07:50.265466 30025 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.29.82.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.29.82.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/rangerkms_127.29.82.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.29.82.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/rangerkms_127.29.82.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.82.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.29.82.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.82.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/HTTP_127.29.82.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.82.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/HTTP_127.29.82.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 07:07:50 dist-test-slave-rmhg krb5kdc[15134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172870, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 07:07:50.349036 30025 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 07:07:50.358999 30025 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 07:07:51.158741 30025 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 07:07:51.158818 30025 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-kms
I20260808 07:07:51.158835 30025 mini_ranger_kms.cc:227] Using postgres at 127.29.82.84:60091
2026-08-08 07:07:51,318 [I] DB FLAVOR :POSTGRES
2026-08-08 07:07:51,319 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 07:07:51,319 [I] Checking connection
2026-08-08 07:07:51,319 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 07:07:51,562 [I] connection success
2026-08-08 07:07:51,562 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 07:07:51,563 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 07:07:51,563 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 07:07:51,799 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 07:07:51,800 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 07:07:51,800 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 07:07:51,800 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.82.84:60091/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 07:07:52,083 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 07:07:52.549454 30025 mini_ranger_kms.cc:310] Created kms service
I20260808 07:07:52.758006 30025 mini_ranger_kms.cc:326] Created kudu user
I20260808 07:07:52.805822 30025 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 07:07:52 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172870, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
I20260808 07:07:53.199529 30025 mini_ranger_kms.cc:384] Added ranger policy
I20260808 07:07:53.199759 30025 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-kms:/tmp/dist-test-taskZ8Eis0/build/release/bin/postgresql.jar:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskZ8Eis0/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 07:07:53.199779 30025 mini_ranger_kms.cc:240] Using host: 127.29.82.84
I20260808 07:07:53.204866 30025 mini_ranger_kms.cc:276] Ranger KMS PID: 15691
I20260808 07:07:53.204952 30025 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.29.82.84:36903
Aug 08, 2026 7:07:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 7:07:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 7:07:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 7:07:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 7:07:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 7:07:54 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 07:07:55 dist-test-slave-rmhg krb5kdc[15134](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172875, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.82.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:55.631074 30025 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.282s user 0.008s sys 0.135s
I20260808 07:07:55.631165 30025 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 07:07:55.631211 30025 mini_ranger_kms.cc:401] 127.29.82.84:36903/kms/v1/keys
Aug 08 07:07:55 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172875, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.82.84@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
Aug 08 07:07:56 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172875, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.82.84@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
Aug 08 07:07:58 dist-test-slave-rmhg krb5kdc[15134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:07:58.658459 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:38597
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:38597
--ranger_config_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.82.84:36903/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:58.743848 15767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:58.744082 15767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:58.744113 15767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:58.745417 15767 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:07:58.745469 15767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:58.745498 15767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:58.745517 15767 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:07:58.745539 15767 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:07:58.747155 15767 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/wal
--ranger_kms_url=127.29.82.84:36903/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:38597
--ranger_config_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:38597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:07:58.747413 15767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:58.747632 15767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:58.752856 15773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:58.752903 15767 server_base.cc:1034] running on GCE node
W20260808 07:07:58.752856 15777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:58.752874 15774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:58.753432 15767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:58.753737 15767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:58.754890 15767 hybrid_clock.cc:648] HybridClock initialized: now 1786172878754875 us; error 33 us; skew 500 ppm
Aug 08 07:07:58 dist-test-slave-rmhg krb5kdc[15134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172878, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:58.757417 15767 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:07:58.757870 15767 webserver.cc:460] Webserver started at http://127.29.82.126:44733/ using document root <none> and password file <none>
I20260808 07:07:58.758091 15767 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:58.758143 15767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:58.758276 15767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:07:58 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172878, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
I20260808 07:07:58.817005 15767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "7770ddb407974aab95e88df824b71804"
format_stamp: "Formatted at 2026-08-08 07:07:58 on dist-test-slave-rmhg"
server_key: "45c1c713354069e49f3bb0c725de8d2a"
server_key_iv: "d1b363b75d4c251e83ab9121c80476ca"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:58.817454 15767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "7770ddb407974aab95e88df824b71804"
format_stamp: "Formatted at 2026-08-08 07:07:58 on dist-test-slave-rmhg"
server_key: "45c1c713354069e49f3bb0c725de8d2a"
server_key_iv: "d1b363b75d4c251e83ab9121c80476ca"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:58.818837 15767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:58.833649 15786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:58.833896 15767 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:07:58.834009 15767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "7770ddb407974aab95e88df824b71804"
format_stamp: "Formatted at 2026-08-08 07:07:58 on dist-test-slave-rmhg"
server_key: "45c1c713354069e49f3bb0c725de8d2a"
server_key_iv: "d1b363b75d4c251e83ab9121c80476ca"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:58.834110 15767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:58.849833 15767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:58.851719 15767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:58.851856 15767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:58.856154 15767 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:38597
I20260808 07:07:58.856211 15860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:38597 every 8 connection(s)
I20260808 07:07:58.856554 15767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:07:58.857303 15862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:07:58.859623 15862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804: Bootstrap starting.
I20260808 07:07:58.860221 15862 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804: Neither blocks nor log segments found. Creating new log.
I20260808 07:07:58.860500 15862 log.cc:824] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804: Log is configured to *not* fsync() on all Append() calls
I20260808 07:07:58.861558 15862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804: No bootstrap required, opened a new log
I20260808 07:07:58.863651 15862 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7770ddb407974aab95e88df824b71804" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38597 } }
I20260808 07:07:58.863811 15862 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:07:58.863833 15862 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7770ddb407974aab95e88df824b71804, State: Initialized, Role: FOLLOWER
I20260808 07:07:58.863974 15862 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7770ddb407974aab95e88df824b71804" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38597 } }
I20260808 07:07:58.864056 15862 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:07:58.864081 15862 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:07:58.864127 15862 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:07:58.864722 15862 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7770ddb407974aab95e88df824b71804" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38597 } }
I20260808 07:07:58.864818 15862 leader_election.cc:302] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7770ddb407974aab95e88df824b71804; no voters:
I20260808 07:07:58.865013 15862 leader_election.cc:288] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:07:58.865056 15867 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:07:58.865257 15867 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 1 LEADER]: Becoming Leader. State: Replica: 7770ddb407974aab95e88df824b71804, State: Running, Role: LEADER
I20260808 07:07:58.865321 15862 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:07:58.865384 15867 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7770ddb407974aab95e88df824b71804" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38597 } }
I20260808 07:07:58.865787 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 15767
I20260808 07:07:58.865877 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:07:58.865854 15868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7770ddb407974aab95e88df824b71804" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7770ddb407974aab95e88df824b71804" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38597 } } }
I20260808 07:07:58.865934 15868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:58.866075 30025 external_mini_cluster.cc:1428] Setting key 6febed391f6a43ceb5119aed0ff4a700
I20260808 07:07:58.866560 15875 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:07:58.866691 15869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7770ddb407974aab95e88df824b71804. Latest consensus state: current_term: 1 leader_uuid: "7770ddb407974aab95e88df824b71804" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7770ddb407974aab95e88df824b71804" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38597 } } }
I20260808 07:07:58.866845 15869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [sys.catalog]: This master's current role is: LEADER
I20260808 07:07:58.867805 15875 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:07:58.868165 15862 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 07:07:58.873522 15875 catalog_manager.cc:1347] Generated new cluster ID: 3213822249b340689b529ef2d763c2b7
I20260808 07:07:58.873711 15875 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:07:58 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:07:58.882375 15882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:58.866761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59408 (local address 127.29.82.126:38597)
0808 07:07:58.867150 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:58.867163 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:58.867368 (+ 205us) server_negotiation.cc:407] Connection header received
0808 07:07:58.867535 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:58.867542 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:58.867626 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:58.868581 (+ 955us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:58.868706 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:58.872112 (+ 3406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:58.873438 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:58.874461 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:58.874933 (+ 472us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:58.877583 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:58.877588 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:58.877589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:58.877603 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:58.879916 (+ 2313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:58.880346 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:58.880350 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:58.880350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:58.880472 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:58.880697 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:58.880698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:58.880698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:58.881080 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:58.881807 (+ 727us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:58.881884 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 07:07:58.882065 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":129,"threads_started":1}
I20260808 07:07:58.902340 15875 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:07:58.903137 15875 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:07:58.906612 15875 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804: Generated new TSK 0
I20260808 07:07:58.906819 15875 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:07:59.583945 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.82.84:36903/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38597
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:59.708514 15932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:59.708846 15932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:59.708886 15932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:59.710631 15932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:59.710705 15932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:59.710747 15932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:07:59.712966 15932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.29.82.84:36903/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:07:59.713299 15932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:59.713658 15932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:59.719298 15940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:59.719312 15941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:59.719530 15932 server_base.cc:1034] running on GCE node
W20260808 07:07:59.719662 15943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:59.719866 15932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:59.720167 15932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:59.721371 15932 hybrid_clock.cc:648] HybridClock initialized: now 1786172879721347 us; error 45 us; skew 500 ppm
Aug 08 07:07:59 dist-test-slave-rmhg krb5kdc[15134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172879, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:59.723940 15932 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:07:59.724504 15932 webserver.cc:460] Webserver started at http://127.29.82.65:46583/ using document root <none> and password file <none>
I20260808 07:07:59.724815 15932 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:59.724890 15932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:59.725034 15932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:07:59 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172879, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
I20260808 07:07:59.739902 15932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "155303d877494643b90a753b809dd1aa"
format_stamp: "Formatted at 2026-08-08 07:07:59 on dist-test-slave-rmhg"
server_key: "4405bff39f83904eb365dee6dac53152"
server_key_iv: "8a698937f7fa45ead71151004ad81ec5"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:59.740458 15932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "155303d877494643b90a753b809dd1aa"
format_stamp: "Formatted at 2026-08-08 07:07:59 on dist-test-slave-rmhg"
server_key: "4405bff39f83904eb365dee6dac53152"
server_key_iv: "8a698937f7fa45ead71151004ad81ec5"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:59.742374 15932 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 07:07:59.756032 15953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:59.756265 15932 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:07:59.756361 15932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "155303d877494643b90a753b809dd1aa"
format_stamp: "Formatted at 2026-08-08 07:07:59 on dist-test-slave-rmhg"
server_key: "4405bff39f83904eb365dee6dac53152"
server_key_iv: "8a698937f7fa45ead71151004ad81ec5"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:59.756464 15932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:07:59.782675 15932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:07:59.785205 15932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:07:59.785449 15932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:07:59.785804 15932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:07:59.786245 15932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:07:59.786337 15932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:59.786437 15932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:07:59.786509 15932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:07:59.792802 15932 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:43361
I20260808 07:07:59.793355 15932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:07:59.797271 16131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:43361 every 8 connection(s)
I20260808 07:07:59.802273 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 15932
I20260808 07:07:59.802376 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:07:59.802580 30025 external_mini_cluster.cc:1428] Setting key 6e2f95d9b5a9ba64994ff4ccf0ef1b78
Aug 08 07:07:59 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172879, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:07:59.810832 16137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:59.798104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:51201 (local address 127.29.82.126:38597)
0808 07:07:59.798259 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 07:07:59.798262 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:07:59.798469 (+ 207us) server_negotiation.cc:407] Connection header received
0808 07:07:59.798980 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:07:59.798982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:07:59.798996 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:07:59.799089 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:07:59.799679 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:59.800189 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:59.801617 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:07:59.801938 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:07:59.801980 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:59.807261 (+ 5281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:07:59.807263 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:07:59.807263 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:07:59.807271 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:07:59.809011 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:59.809581 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:59.809583 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:59.809583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:59.809650 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:07:59.809952 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:07:59.809953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:07:59.809953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:07:59.810157 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:07:59.810217 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:07:59.810622 (+ 405us) server_negotiation.cc:299] Negotiation successful
0808 07:07:59.810716 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":91,"threads_started":1}
I20260808 07:07:59.811892 16136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:07:59.798055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38597 (local address 127.29.82.65:51201)
0808 07:07:59.798338 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 07:07:59.798375 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:07:59.798876 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:07:59.799171 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:07:59.799175 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:07:59.799370 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:07:59.799584 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:59.799589 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:59.800277 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:59.800278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:59.801504 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:07:59.801508 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:07:59.802821 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:07:59.802821 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:07:59.802978 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:07:59.805446 (+ 2468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:07:59.805459 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:07:59.807125 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:07:59.809129 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:59.809137 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:59.809141 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:59.809483 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:59.809725 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:07:59.809726 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:07:59.809726 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:07:59.809870 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:07:59.810255 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:07:59.810264 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:07:59.810453 (+ 189us) client_negotiation.cc:769] Sending connection context
0808 07:07:59.811451 (+ 998us) client_negotiation.cc:240] Negotiation successful
0808 07:07:59.811638 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":97,"threads_started":1}
I20260808 07:07:59.812681 16133 heartbeater.cc:347] Connected to a master server at 127.29.82.126:38597
I20260808 07:07:59.812793 16133 heartbeater.cc:464] Registering TS with master...
I20260808 07:07:59.812978 16133 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
I20260808 07:07:59.813565 15811 ts_manager.cc:194] Registered new tserver with Master: 155303d877494643b90a753b809dd1aa (127.29.82.65:43361)
I20260808 07:07:59.814281 15811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:51201
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:07:59.832289 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.82.84:36903/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38597
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:07:59.942005 16142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:07:59.942217 16142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:07:59.942251 16142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:07:59.943408 16142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:07:59.943457 16142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:07:59.943492 16142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:07:59.945071 16142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.29.82.84:36903/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:07:59.945477 16142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:07:59.945721 16142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:07:59.950690 16157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:07:59.950975 16150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:59.951380 16142 server_base.cc:1034] running on GCE node
W20260808 07:07:59.951447 16155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:07:59.951666 16142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:07:59.951927 16142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:07:59.953089 16142 hybrid_clock.cc:648] HybridClock initialized: now 1786172879953072 us; error 35 us; skew 500 ppm
Aug 08 07:07:59 dist-test-slave-rmhg krb5kdc[15134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172879, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:59.956328 16142 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:07:59.956911 16142 webserver.cc:460] Webserver started at http://127.29.82.66:39655/ using document root <none> and password file <none>
I20260808 07:07:59.957254 16142 fs_manager.cc:359] Metadata directory not provided
I20260808 07:07:59.957325 16142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:07:59.957516 16142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:07:59 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172879, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
Aug 08 07:07:59 dist-test-slave-rmhg krb5kdc[15134](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172879, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:07:59.974511 16142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "dcbed4a893544e3ab55b07e024d150cd"
format_stamp: "Formatted at 2026-08-08 07:07:59 on dist-test-slave-rmhg"
server_key: "c52a209c4b3eced60a0b7dcf87b840bb"
server_key_iv: "b3b50ccbc7ce4ee959e6db6bcdaf1c51"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:59.975095 16142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "dcbed4a893544e3ab55b07e024d150cd"
format_stamp: "Formatted at 2026-08-08 07:07:59 on dist-test-slave-rmhg"
server_key: "c52a209c4b3eced60a0b7dcf87b840bb"
server_key_iv: "b3b50ccbc7ce4ee959e6db6bcdaf1c51"
server_key_version: "kuduclusterkey@0"
I20260808 07:07:59.980532 16142 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.000s
I20260808 07:08:00.008828 16167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:00.013406 16142 fs_manager.cc:725] Time spent opening block manager: real 0.019s user 0.001s sys 0.000s
I20260808 07:08:00.013572 16142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "dcbed4a893544e3ab55b07e024d150cd"
format_stamp: "Formatted at 2026-08-08 07:07:59 on dist-test-slave-rmhg"
server_key: "c52a209c4b3eced60a0b7dcf87b840bb"
server_key_iv: "b3b50ccbc7ce4ee959e6db6bcdaf1c51"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:00.013689 16142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:00.030823 16142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:00.033385 16142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:00.033552 16142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:00.033855 16142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:00.034303 16142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:00.034355 16142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:00.034387 16142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:00.034451 16142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:00.044111 16142 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:44171
I20260808 07:08:00.044275 16341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:44171 every 8 connection(s)
I20260808 07:08:00.044675 16142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:08:00 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172879, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:00.051178 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 16142
I20260808 07:08:00.051276 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:08:00.051491 30025 external_mini_cluster.cc:1428] Setting key ef000ab66114e4fc202157e5ad926a91
I20260808 07:08:00.054602 16137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:00.045540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:39289 (local address 127.29.82.126:38597)
0808 07:08:00.045600 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:00.045602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:00.045815 (+ 213us) server_negotiation.cc:407] Connection header received
0808 07:08:00.046352 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:00.046354 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:00.046371 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:00.046400 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:00.047308 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.047823 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.048873 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.049094 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.049175 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:00.051307 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:00.051309 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:00.051309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:00.051319 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:00.052944 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:00.053481 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:00.053483 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:00.053483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:00.053544 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:00.053805 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:00.053806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:00.053806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:00.053935 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:00.053976 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:00.054364 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 07:08:00.054488 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:08:00.055119 16344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:00.045485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38597 (local address 127.29.82.66:39289)
0808 07:08:00.045666 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:00.045711 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:00.046234 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:00.046601 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:00.046606 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:00.046864 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:00.047184 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:00.047193 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.047913 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.047914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:00.048784 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:00.048787 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.049215 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.049216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:00.049338 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:00.049852 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:00.049861 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:00.051182 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:00.053044 (+ 1862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:00.053053 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:00.053056 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:00.053382 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:00.053609 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:00.053610 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:00.053610 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:00.053739 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:00.054020 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:00.054028 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:00.054205 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 07:08:00.054699 (+ 494us) client_negotiation.cc:240] Negotiation successful
0808 07:08:00.054882 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":92,"threads_started":1}
I20260808 07:08:00.055666 16342 heartbeater.cc:347] Connected to a master server at 127.29.82.126:38597
I20260808 07:08:00.055768 16342 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:00.055959 16342 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
I20260808 07:08:00.056339 15811 ts_manager.cc:194] Registered new tserver with Master: dcbed4a893544e3ab55b07e024d150cd (127.29.82.66:44171)
I20260808 07:08:00.056706 15811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:39289
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:08:00.081971 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.82.84:36903/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38597
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:00.174225 16350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:00.174444 16350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:00.174479 16350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:00.175662 16350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:00.175709 16350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:00.175742 16350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:08:00.177476 16350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.29.82.84:36903/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:38597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:00.177748 16350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:00.178020 16350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:00.182935 16357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:00.182933 16364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:00.183291 16359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:00.183737 16350 server_base.cc:1034] running on GCE node
I20260808 07:08:00.183950 16350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:00.184204 16350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:00.185348 16350 hybrid_clock.cc:648] HybridClock initialized: now 1786172880185337 us; error 29 us; skew 500 ppm
Aug 08 07:08:00 dist-test-slave-rmhg krb5kdc[15134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172880, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:00.187940 16350 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:08:00.188375 16350 webserver.cc:460] Webserver started at http://127.29.82.67:43093/ using document root <none> and password file <none>
I20260808 07:08:00.188612 16350 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:00.188664 16350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:00.188796 16350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:08:00 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172880, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
I20260808 07:08:00.202664 16350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb"
format_stamp: "Formatted at 2026-08-08 07:08:00 on dist-test-slave-rmhg"
server_key: "02c68940f70f7a1d275e77a72cc4451b"
server_key_iv: "f07d9ec514f9a5f3b58c76e8fe4f85b4"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:00.203184 16350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb"
format_stamp: "Formatted at 2026-08-08 07:08:00 on dist-test-slave-rmhg"
server_key: "02c68940f70f7a1d275e77a72cc4451b"
server_key_iv: "f07d9ec514f9a5f3b58c76e8fe4f85b4"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:00.206744 16350 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260808 07:08:00.227283 16374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:00.227578 16350 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260808 07:08:00.227711 16350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb"
format_stamp: "Formatted at 2026-08-08 07:08:00 on dist-test-slave-rmhg"
server_key: "02c68940f70f7a1d275e77a72cc4451b"
server_key_iv: "f07d9ec514f9a5f3b58c76e8fe4f85b4"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:00.227818 16350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:00.250665 16350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:00.252882 16350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:00.253206 16350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:00.253509 16350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:00.254033 16350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:00.254082 16350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:00.254136 16350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:00.254163 16350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:00.261914 16350 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:44195
I20260808 07:08:00.262106 16541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:44195 every 8 connection(s)
I20260808 07:08:00.262351 16350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:08:00 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172880, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:00.271225 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 16350
I20260808 07:08:00.271371 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:08:00.271646 30025 external_mini_cluster.cc:1428] Setting key 28eca36add2550370d745d8d06ee6f31
I20260808 07:08:00.271713 16137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:00.263171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:36667 (local address 127.29.82.126:38597)
0808 07:08:00.263232 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:00.263234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:00.263460 (+ 226us) server_negotiation.cc:407] Connection header received
0808 07:08:00.263991 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:00.263993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:00.264007 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:00.264062 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:00.264661 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.265212 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.266237 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.266510 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.266579 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:00.268841 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:00.268843 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:00.268843 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:00.268851 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:00.270262 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:00.270683 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:00.270684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:00.270684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:00.270742 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:00.271002 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:00.271004 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:00.271004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:00.271126 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:00.271183 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:00.271526 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 07:08:00.271617 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:08:00.271904 16545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:00.263156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38597 (local address 127.29.82.67:36667)
0808 07:08:00.263340 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:00.263378 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:00.263886 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:00.264138 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:00.264142 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:00.264339 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:00.264567 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:00.264572 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.265293 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.265294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:00.266154 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:00.266156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.266610 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.266612 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:00.266747 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:00.267283 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:00.267292 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:00.268740 (+ 1448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:00.270345 (+ 1605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:00.270354 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:00.270357 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:00.270608 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:00.270799 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:00.270799 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:00.270800 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:00.270942 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:00.271183 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:00.271190 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:00.271356 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 07:08:00.271501 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 07:08:00.271668 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":100,"threads_started":1}
I20260808 07:08:00.272832 16543 heartbeater.cc:347] Connected to a master server at 127.29.82.126:38597
I20260808 07:08:00.272929 16543 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:00.273121 16543 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
I20260808 07:08:00.273599 15811 ts_manager.cc:194] Registered new tserver with Master: 63b4e64ac6664b4f8470cdbae6d7e6fb (127.29.82.67:44195)
I20260808 07:08:00.273978 15811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:36667
I20260808 07:08:00.283491 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:08:00.284220 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 15932
I20260808 07:08:00.319551 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 16142
I20260808 07:08:00.348637 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 16350
I20260808 07:08:00.384100 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 15767
I20260808 07:08:00.396502 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:38597
--webserver_interface=127.29.82.126
--webserver_port=44733
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:38597
--ranger_config_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.82.84:36903/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.82.84:36903/kms with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:00.480746 16546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:00.480969 16546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:00.481002 16546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:00.482182 16546 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:08:00.482227 16546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:00.482245 16546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:00.482261 16546 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:08:00.482276 16546 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:08:00.483920 16546 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.82.84:36903/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:38597
--ranger_config_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:38597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=44733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:00.484160 16546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:00.484372 16546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:00.489280 16554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:00.489308 16546 server_base.cc:1034] running on GCE node
W20260808 07:08:00.489301 16552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:00.489277 16558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:00.489709 16546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:00.489992 16546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:00.491144 16546 hybrid_clock.cc:648] HybridClock initialized: now 1786172880491127 us; error 34 us; skew 500 ppm
Aug 08 07:08:00 dist-test-slave-rmhg krb5kdc[15134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172880, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:00.493675 16546 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:08:00.494088 16546 webserver.cc:460] Webserver started at http://127.29.82.126:44733/ using document root <none> and password file <none>
I20260808 07:08:00.494298 16546 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:00.494356 16546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 07:08:00 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172880, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
I20260808 07:08:00.562976 16546 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:00.563740 16571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:00.563922 16546 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:00.564041 16546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "7770ddb407974aab95e88df824b71804"
format_stamp: "Formatted at 2026-08-08 07:07:58 on dist-test-slave-rmhg"
server_key: "45c1c713354069e49f3bb0c725de8d2a"
server_key_iv: "d1b363b75d4c251e83ab9121c80476ca"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:00.564551 16546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:00.592811 16546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:00.594745 16546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:00.594879 16546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:00.599077 16546 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:38597
I20260808 07:08:00.599131 16651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:38597 every 8 connection(s)
I20260808 07:08:00.599500 16546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:08:00.600800 16653 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:08:00.601440 16653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804: Bootstrap starting.
I20260808 07:08:00.603550 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 16546
I20260808 07:08:00.603889 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.82.84:36903/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:43361
--local_ip_for_outbound_sockets=127.29.82.65
--tserver_master_addrs=127.29.82.126:38597
--webserver_port=46583
--webserver_interface=127.29.82.65
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.82.84:36903/kms with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:08:00.609894 16653 log.cc:824] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:00.611752 16653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:08:00.612023 16653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804: Bootstrap complete.
I20260808 07:08:00.614355 16653 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7770ddb407974aab95e88df824b71804" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38597 } }
I20260808 07:08:00.614598 16653 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7770ddb407974aab95e88df824b71804, State: Initialized, Role: FOLLOWER
I20260808 07:08:00.614794 16653 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7770ddb407974aab95e88df824b71804" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38597 } }
I20260808 07:08:00.614862 16653 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:08:00.614903 16653 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:08:00.614951 16653 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:08:00.615978 16653 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7770ddb407974aab95e88df824b71804" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38597 } }
I20260808 07:08:00.616070 16653 leader_election.cc:302] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7770ddb407974aab95e88df824b71804; no voters:
I20260808 07:08:00.616245 16653 leader_election.cc:288] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 07:08:00.616298 16657 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:08:00.616492 16657 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [term 2 LEADER]: Becoming Leader. State: Replica: 7770ddb407974aab95e88df824b71804, State: Running, Role: LEADER
I20260808 07:08:00.616534 16653 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:08:00.616671 16657 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7770ddb407974aab95e88df824b71804" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38597 } }
I20260808 07:08:00.616981 16658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7770ddb407974aab95e88df824b71804" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7770ddb407974aab95e88df824b71804" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38597 } } }
I20260808 07:08:00.617057 16658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:00.617301 16661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7770ddb407974aab95e88df824b71804. Latest consensus state: current_term: 2 leader_uuid: "7770ddb407974aab95e88df824b71804" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7770ddb407974aab95e88df824b71804" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38597 } } }
I20260808 07:08:00.617398 16661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804 [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:00.617631 16667 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:08:00.618170 16667 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:08:00.618307 16667 catalog_manager.cc:1259] Loaded cluster ID: 3213822249b340689b529ef2d763c2b7
I20260808 07:08:00.618346 16667 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:08:00.618516 16653 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 07:08:00.622613 16667 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:08:00.623232 16667 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804: Loaded TSK: 0
I20260808 07:08:00.623545 16667 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:08:00.719570 16655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:00.719862 16655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:00.719902 16655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:00.721662 16655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:00.721788 16655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:00.721876 16655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:08:00.724128 16655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.82.84:36903/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:43361
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=46583
--tserver_master_addrs=127.29.82.126:38597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:00.724617 16655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:00.724927 16655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:00.731525 16706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:00.731534 16707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:00.732118 16709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:00.732661 16655 server_base.cc:1034] running on GCE node
I20260808 07:08:00.732889 16655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:00.733225 16655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:00.734411 16655 hybrid_clock.cc:648] HybridClock initialized: now 1786172880734394 us; error 29 us; skew 500 ppm
Aug 08 07:08:00 dist-test-slave-rmhg krb5kdc[15134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172880, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:00.737802 16655 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:08:00.738418 16655 webserver.cc:460] Webserver started at http://127.29.82.65:46583/ using document root <none> and password file <none>
I20260808 07:08:00.738724 16655 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:00.738818 16655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 07:08:00 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172880, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
I20260808 07:08:00.760375 16655 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 07:08:00.761758 16721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:00.761950 16655 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:08:00.762043 16655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "155303d877494643b90a753b809dd1aa"
format_stamp: "Formatted at 2026-08-08 07:07:59 on dist-test-slave-rmhg"
server_key: "4405bff39f83904eb365dee6dac53152"
server_key_iv: "8a698937f7fa45ead71151004ad81ec5"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:00.762547 16655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:00.778432 16655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:00.781121 16655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:00.781425 16655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:00.781749 16655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:00.782197 16655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:00.782251 16655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:00.782284 16655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:00.782338 16655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:00.789786 16655 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:43361
I20260808 07:08:00.790022 16891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:43361 every 8 connection(s)
I20260808 07:08:00.790360 16655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:08:00.791488 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 16655
I20260808 07:08:00.791764 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.82.84:36903/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:44171
--local_ip_for_outbound_sockets=127.29.82.66
--tserver_master_addrs=127.29.82.126:38597
--webserver_port=39655
--webserver_interface=127.29.82.66
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.82.84:36903/kms with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:08:00 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172880, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:00.801681 16896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:00.791342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:53703 (local address 127.29.82.126:38597)
0808 07:08:00.792437 (+ 1095us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:00.792448 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:00.792492 (+ 44us) server_negotiation.cc:407] Connection header received
0808 07:08:00.792650 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:00.792656 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:00.792715 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:00.792852 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:00.793735 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.794648 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.795863 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.796348 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.796458 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:00.798442 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:00.798447 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:00.798447 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:00.798458 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:00.799969 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:00.800363 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:00.800366 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:00.800367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:00.800459 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:00.800693 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:00.800694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:00.800694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:00.800933 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:00.801009 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:00.801357 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 07:08:00.801470 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1024,"thread_start_us":92,"threads_started":1}
I20260808 07:08:00.801692 16895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:00.791263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38597 (local address 127.29.82.65:53703)
0808 07:08:00.791528 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:00.791572 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:00.792195 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:00.793026 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:00.793030 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:00.793292 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:00.793612 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:00.793619 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.794762 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.794763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:00.795632 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:00.795635 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.796456 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.796458 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:00.796581 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:00.797074 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:00.797084 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:00.798334 (+ 1250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:00.800053 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:00.800060 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:00.800062 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:00.800282 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:00.800528 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:00.800529 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:00.800529 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:00.800634 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:00.801005 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:00.801012 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:00.801145 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 07:08:00.801278 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 07:08:00.801454 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":86,"threads_started":1}
I20260808 07:08:00.803007 16892 heartbeater.cc:347] Connected to a master server at 127.29.82.126:38597
I20260808 07:08:00.803117 16892 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:00.803304 16892 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
W20260808 07:08:00.804131 16892 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:38597 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 07:08:00.804210 16892 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:00.804293 16892 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
I20260808 07:08:00.804661 16892 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:00.804744 16892 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
W20260808 07:08:00.805079 16892 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:08:00.896131 16897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:00.896409 16897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:00.896448 16897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:00.897845 16897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:00.897899 16897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:00.897949 16897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:08:00.900197 16897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.82.84:36903/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:44171
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=39655
--tserver_master_addrs=127.29.82.126:38597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:00.900588 16897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:00.900928 16897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:00.907373 16908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:00.907519 16911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:00.909659 16909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:00.910373 16897 server_base.cc:1034] running on GCE node
I20260808 07:08:00.910609 16897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:00.910868 16897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:00.912047 16897 hybrid_clock.cc:648] HybridClock initialized: now 1786172880912024 us; error 35 us; skew 500 ppm
Aug 08 07:08:00 dist-test-slave-rmhg krb5kdc[15134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172880, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:00.915441 16897 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:08:00.916118 16897 webserver.cc:460] Webserver started at http://127.29.82.66:39655/ using document root <none> and password file <none>
I20260808 07:08:00.916502 16897 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:00.916702 16897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 07:08:00 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172880, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
I20260808 07:08:00.932168 16897 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:00.933275 16927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:00.933447 16897 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:00.933552 16897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "dcbed4a893544e3ab55b07e024d150cd"
format_stamp: "Formatted at 2026-08-08 07:07:59 on dist-test-slave-rmhg"
server_key: "c52a209c4b3eced60a0b7dcf87b840bb"
server_key_iv: "b3b50ccbc7ce4ee959e6db6bcdaf1c51"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:00.934019 16897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:00.971848 16897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:00.974115 16897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:00.974246 16897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:00.974502 16897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:00.974867 16897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:00.974903 16897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:00.974925 16897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:00.974936 16897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:00.981918 16897 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:44171
I20260808 07:08:00.982342 16897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:08:00.983085 17088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:44171 every 8 connection(s)
Aug 08 07:08:00 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172880, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:00.991071 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 16897
I20260808 07:08:00.991392 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.82.84:36903/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:44195
--local_ip_for_outbound_sockets=127.29.82.67
--tserver_master_addrs=127.29.82.126:38597
--webserver_port=43093
--webserver_interface=127.29.82.67
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.82.84:36903/kms with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:08:00.993355 16896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:00.983447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:57157 (local address 127.29.82.126:38597)
0808 07:08:00.983496 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:00.983498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:00.983580 (+ 82us) server_negotiation.cc:407] Connection header received
0808 07:08:00.984079 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:00.984081 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:00.984099 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:00.984147 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:00.984855 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.985415 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.986810 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.987142 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.987233 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:00.989749 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:00.989751 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:00.989751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:00.989761 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:00.991509 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:00.992034 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:00.992036 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:00.992037 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:00.992118 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:00.992433 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:00.992435 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:00.992435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:00.992584 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:00.992646 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:00.993135 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 07:08:00.993256 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 07:08:00.994068 17091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:00.983135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38597 (local address 127.29.82.66:57157)
0808 07:08:00.983449 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:00.983496 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:00.983975 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:00.984233 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:00.984238 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:00.984483 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:00.984752 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:00.984758 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.985507 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.985509 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:00.986704 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:00.986708 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:00.987266 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:00.987267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:00.987417 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:00.988033 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:00.988052 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:00.989630 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:00.991615 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:00.991623 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:00.991626 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:00.991932 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:00.992199 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:00.992199 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:00.992200 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:00.992347 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:00.992726 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:00.992735 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:00.992957 (+ 222us) client_negotiation.cc:769] Sending connection context
0808 07:08:00.993603 (+ 646us) client_negotiation.cc:240] Negotiation successful
0808 07:08:00.993787 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":75,"threads_started":1}
I20260808 07:08:00.994658 17089 heartbeater.cc:347] Connected to a master server at 127.29.82.126:38597
I20260808 07:08:00.994769 17089 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:00.994975 17089 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
W20260808 07:08:00.995765 17089 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:38597 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 07:08:00.995851 17089 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:00.995946 17089 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
I20260808 07:08:00.996440 17089 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:00.996520 17089 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
W20260808 07:08:00.996891 17089 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:08:01.106242 17093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:01.106616 17093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:01.106701 17093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:01.108567 17093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:01.108701 17093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:01.108790 17093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:08:01.111261 17093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.82.84:36903/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:44195
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=43093
--tserver_master_addrs=127.29.82.126:38597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:01.111799 17093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:01.112149 17093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:01.120190 17103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:01.120190 17108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:01.120484 17104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:01.121802 17093 server_base.cc:1034] running on GCE node
I20260808 07:08:01.122151 17093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:01.122494 17093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:01.123675 17093 hybrid_clock.cc:648] HybridClock initialized: now 1786172881123644 us; error 38 us; skew 500 ppm
Aug 08 07:08:01 dist-test-slave-rmhg krb5kdc[15134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172881, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:01.126547 17093 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:08:01.127056 17093 webserver.cc:460] Webserver started at http://127.29.82.67:43093/ using document root <none> and password file <none>
I20260808 07:08:01.127297 17093 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:01.127365 17093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 07:08:01 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172881, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
I20260808 07:08:01.142807 17093 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:01.143579 17118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:01.143733 17093 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:01.143826 17093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb"
format_stamp: "Formatted at 2026-08-08 07:08:00 on dist-test-slave-rmhg"
server_key: "02c68940f70f7a1d275e77a72cc4451b"
server_key_iv: "f07d9ec514f9a5f3b58c76e8fe4f85b4"
server_key_version: "kuduclusterkey@0"
I20260808 07:08:01.144191 17093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:01.164848 17093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:01.166790 17093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:01.166945 17093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:01.167284 17093 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:01.167670 17093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:01.167714 17093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:01.167744 17093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:01.167769 17093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:01.174993 17093 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:44195
I20260808 07:08:01.175613 17093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:08:01.176352 17303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:44195 every 8 connection(s)
I20260808 07:08:01.181730 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 17093
Aug 08 07:08:01 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172881, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:01.186856 16896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:01.177532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:43245 (local address 127.29.82.126:38597)
0808 07:08:01.177581 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:01.177583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:01.177936 (+ 353us) server_negotiation.cc:407] Connection header received
0808 07:08:01.178427 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:01.178429 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:01.178442 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:01.178497 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:01.179109 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:01.179612 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:01.180622 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:01.180818 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:01.180875 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:01.183207 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:01.183209 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:01.183210 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:01.183217 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:01.184976 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:01.185776 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:01.185779 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:01.185779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:01.185848 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:01.186169 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:01.186170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:01.186170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:01.186284 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:01.186334 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:01.186701 (+ 367us) server_negotiation.cc:299] Negotiation successful
0808 07:08:01.186786 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:08:01.187063 17306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:01.177220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38597 (local address 127.29.82.67:43245)
0808 07:08:01.177802 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:01.177839 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:01.178323 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:01.178616 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:01.178620 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:01.178794 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:01.179008 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:01.179013 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:01.179697 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:01.179698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:01.180529 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:01.180532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:01.180907 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:01.180909 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:01.181058 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:01.181649 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:01.181659 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:01.183120 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:01.185072 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:01.185080 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:01.185083 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:01.185686 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:01.185931 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:01.185932 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:01.185932 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:01.186085 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:01.186344 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:01.186350 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:01.186536 (+ 186us) client_negotiation.cc:769] Sending connection context
0808 07:08:01.186650 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 07:08:01.186820 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":87,"threads_started":1}
I20260808 07:08:01.187752 17304 heartbeater.cc:347] Connected to a master server at 127.29.82.126:38597
I20260808 07:08:01.187857 17304 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:01.188063 17304 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
W20260808 07:08:01.188827 17304 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:38597 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 07:08:01.188910 17304 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:01.188971 17304 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
I20260808 07:08:01.189366 17304 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:01.189451 17304 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
W20260808 07:08:01.189779 17304 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 07:08:01.191977 17310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:01.182191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39182 (local address 127.29.82.126:38597)
0808 07:08:01.182640 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:01.182642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:01.182650 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:08:01.182671 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:01.182672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:01.182683 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:01.182756 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:01.183376 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:01.183867 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:01.184748 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:01.184948 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:01.185003 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:01.186356 (+ 1353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:01.186356 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:01.186357 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:01.186361 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:01.188029 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:01.191241 (+ 3212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:01.191242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:01.191243 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:01.191299 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:01.191473 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:01.191473 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:01.191474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:01.191579 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:01.191745 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:01.191791 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 07:08:01.191881 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":90,"threads_started":1}
Aug 08 07:08:01 dist-test-slave-rmhg krb5kdc[15134](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172881, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:01.805231 16892 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:01.805401 16892 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
I20260808 07:08:01.805801 16598 ts_manager.cc:194] Registered new tserver with Master: 155303d877494643b90a753b809dd1aa (127.29.82.65:43361)
I20260808 07:08:01.806806 16598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:53703
I20260808 07:08:01.997074 17089 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:01.997279 17089 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
I20260808 07:08:01.997885 16598 ts_manager.cc:194] Registered new tserver with Master: dcbed4a893544e3ab55b07e024d150cd (127.29.82.66:44171)
I20260808 07:08:01.998454 16598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:57157
Aug 08 07:08:02 dist-test-slave-rmhg krb5kdc[15134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172881, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for HTTP/127.29.82.84@KRBTEST.COM
I20260808 07:08:02.189981 17304 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:02.190151 17304 heartbeater.cc:511] Master 127.29.82.126:38597 requested a full tablet report, sending...
I20260808 07:08:02.190589 16598 ts_manager.cc:194] Registered new tserver with Master: 63b4e64ac6664b4f8470cdbae6d7e6fb (127.29.82.67:44195)
I20260808 07:08:02.190982 16598 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:43245
I20260808 07:08:02.192773 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:08:02.202950 17338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:02.193743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39192 (local address 127.29.82.126:38597)
0808 07:08:02.193857 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:02.193859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:02.193924 (+ 65us) server_negotiation.cc:407] Connection header received
0808 07:08:02.193999 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:02.194000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:02.194012 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:02.194076 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:02.194612 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.195122 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.195831 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.196079 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.196241 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:02.200229 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:02.200230 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:02.200231 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:02.200240 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:02.201704 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:02.202030 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:02.202031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:02.202032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:02.202088 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:02.202256 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:02.202257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:02.202258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:02.202377 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:02.202465 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:02.202776 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 07:08:02.202869 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":58,"threads_started":1}
I20260808 07:08:02.204905 16598 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39192:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:08:02.206686 16598 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:08:02.214207 17351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:02.209455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:44171 (local address 127.0.0.1:47070)
0808 07:08:02.210294 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:02.210339 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:02.210396 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:02.210645 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:02.210649 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:02.210651 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:02.210726 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:02.210728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.211687 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.211689 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:02.212727 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:02.212729 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.213848 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.213849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:02.213956 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:02.213973 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 07:08:02.214043 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 07:08:02.214110 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":805,"thread_start_us":93,"threads_started":1}
I20260808 07:08:02.215108 17353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:02.209722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47070 (local address 127.29.82.66:44171)
0808 07:08:02.210507 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:02.210511 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:02.210518 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:08:02.210547 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:02.210548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:02.210562 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:02.210631 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:02.210821 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.211598 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.212806 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.213649 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.213739 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:02.213813 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:02.214934 (+ 1121us) server_negotiation.cc:299] Negotiation successful
0808 07:08:02.214985 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756,"thread_start_us":54,"threads_started":1}
I20260808 07:08:02.216076 16984 tablet_service.cc:1467] Processing CreateTablet for tablet 704e0229ec584f3c95a09534b86d4276 (DEFAULT_TABLE table=test-table [id=5e8cb9c405ab499bb27813314041a5ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:02.216514 16984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 704e0229ec584f3c95a09534b86d4276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:02.217438 17356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:02.209897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33038 (local address 127.29.82.65:43361)
0808 07:08:02.210156 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:02.210163 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:02.213329 (+ 3166us) server_negotiation.cc:407] Connection header received
0808 07:08:02.213379 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:02.213382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:02.213400 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:02.213488 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:02.213742 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.214794 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.215988 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.216867 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.216918 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:02.216979 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:02.217286 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 07:08:02.217334 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":65,"threads_started":1}
I20260808 07:08:02.217720 17347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:02.209455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:43361 (local address 127.0.0.1:33038)
0808 07:08:02.213227 (+ 3772us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:02.213241 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:02.213313 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:02.213584 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:02.213585 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:02.213588 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:02.213644 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:02.213646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.214880 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.214880 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:02.215844 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:02.215847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.217109 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.217110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:02.217195 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:02.217199 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:08:02.217586 (+ 387us) client_negotiation.cc:240] Negotiation successful
0808 07:08:02.217643 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3750,"mutex_wait_us":2,"thread_start_us":94,"threads_started":1}
I20260808 07:08:02.218514 16799 tablet_service.cc:1467] Processing CreateTablet for tablet 704e0229ec584f3c95a09534b86d4276 (DEFAULT_TABLE table=test-table [id=5e8cb9c405ab499bb27813314041a5ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:02.218927 16799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 704e0229ec584f3c95a09534b86d4276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:02.219707 17351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:02.209521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:44195 (local address 127.0.0.1:47830)
0808 07:08:02.214814 (+ 5293us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:02.214825 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:02.214861 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:02.216114 (+ 1253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:02.216116 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:02.216118 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:02.216153 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:02.216155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.217317 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.217318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:02.218351 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:02.218354 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.219482 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.219483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:02.219547 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:02.219551 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:08:02.219598 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:08:02.219638 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5280,"thread_start_us":128,"threads_started":1}
I20260808 07:08:02.220057 17355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:02.209880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47830 (local address 127.29.82.67:44195)
0808 07:08:02.210770 (+ 890us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:02.210775 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:02.215814 (+ 5039us) server_negotiation.cc:407] Connection header received
0808 07:08:02.215862 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:02.215864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:02.215881 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:02.215965 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:02.216235 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.217224 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.218451 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.219316 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.219384 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:02.219444 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:02.219895 (+ 451us) server_negotiation.cc:299] Negotiation successful
0808 07:08:02.219941 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":854,"thread_start_us":58,"threads_started":1}
I20260808 07:08:02.220979 17191 tablet_service.cc:1467] Processing CreateTablet for tablet 704e0229ec584f3c95a09534b86d4276 (DEFAULT_TABLE table=test-table [id=5e8cb9c405ab499bb27813314041a5ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:02.221658 17191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 704e0229ec584f3c95a09534b86d4276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:02.223608 17358 tablet_bootstrap.cc:492] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa: Bootstrap starting.
I20260808 07:08:02.224721 17358 tablet_bootstrap.cc:654] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:02.225664 17358 log.cc:824] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:02.226231 17357 tablet_bootstrap.cc:492] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd: Bootstrap starting.
I20260808 07:08:02.226818 17358 tablet_bootstrap.cc:492] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa: No bootstrap required, opened a new log
I20260808 07:08:02.226892 17358 ts_tablet_manager.cc:1397] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 07:08:02.227171 17357 tablet_bootstrap.cc:654] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:02.227898 17357 log.cc:824] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:02.228259 17359 tablet_bootstrap.cc:492] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb: Bootstrap starting.
I20260808 07:08:02.229431 17359 tablet_bootstrap.cc:654] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:02.230213 17359 log.cc:824] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:02.231201 17357 tablet_bootstrap.cc:492] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd: No bootstrap required, opened a new log
I20260808 07:08:02.231272 17357 ts_tablet_manager.cc:1397] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 07:08:02.231717 17358 raft_consensus.cc:348] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbed4a893544e3ab55b07e024d150cd" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44171 } } peers { permanent_uuid: "155303d877494643b90a753b809dd1aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43361 } } peers { permanent_uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 44195 } }
I20260808 07:08:02.231889 17358 raft_consensus.cc:374] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:02.231925 17358 raft_consensus.cc:729] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 155303d877494643b90a753b809dd1aa, State: Initialized, Role: FOLLOWER
I20260808 07:08:02.232077 17358 consensus_queue.cc:260] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbed4a893544e3ab55b07e024d150cd" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44171 } } peers { permanent_uuid: "155303d877494643b90a753b809dd1aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43361 } } peers { permanent_uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 44195 } }
I20260808 07:08:02.232404 17358 ts_tablet_manager.cc:1428] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260808 07:08:02.232532 16892 heartbeater.cc:503] Master 127.29.82.126:38597 was elected leader, sending a full tablet report...
I20260808 07:08:02.235013 17357 raft_consensus.cc:348] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbed4a893544e3ab55b07e024d150cd" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44171 } } peers { permanent_uuid: "155303d877494643b90a753b809dd1aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43361 } } peers { permanent_uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 44195 } }
I20260808 07:08:02.235175 17357 raft_consensus.cc:374] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:02.235204 17357 raft_consensus.cc:729] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcbed4a893544e3ab55b07e024d150cd, State: Initialized, Role: FOLLOWER
I20260808 07:08:02.235321 17357 consensus_queue.cc:260] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbed4a893544e3ab55b07e024d150cd" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44171 } } peers { permanent_uuid: "155303d877494643b90a753b809dd1aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43361 } } peers { permanent_uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 44195 } }
I20260808 07:08:02.235632 17357 ts_tablet_manager.cc:1428] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 07:08:02.235745 17089 heartbeater.cc:503] Master 127.29.82.126:38597 was elected leader, sending a full tablet report...
W20260808 07:08:02.235859 17090 tablet.cc:2369] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:08:02.237094 17359 tablet_bootstrap.cc:492] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb: No bootstrap required, opened a new log
I20260808 07:08:02.237228 17359 ts_tablet_manager.cc:1397] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20260808 07:08:02.241484 17359 raft_consensus.cc:348] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbed4a893544e3ab55b07e024d150cd" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44171 } } peers { permanent_uuid: "155303d877494643b90a753b809dd1aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43361 } } peers { permanent_uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 44195 } }
I20260808 07:08:02.241677 17359 raft_consensus.cc:374] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:02.241709 17359 raft_consensus.cc:729] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63b4e64ac6664b4f8470cdbae6d7e6fb, State: Initialized, Role: FOLLOWER
I20260808 07:08:02.241878 17359 consensus_queue.cc:260] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbed4a893544e3ab55b07e024d150cd" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44171 } } peers { permanent_uuid: "155303d877494643b90a753b809dd1aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43361 } } peers { permanent_uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 44195 } }
I20260808 07:08:02.242233 17359 ts_tablet_manager.cc:1428] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260808 07:08:02.242317 17304 heartbeater.cc:503] Master 127.29.82.126:38597 was elected leader, sending a full tablet report...
I20260808 07:08:02.279930 17369 raft_consensus.cc:482] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:08:02.280242 17369 raft_consensus.cc:504] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbed4a893544e3ab55b07e024d150cd" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44171 } } peers { permanent_uuid: "155303d877494643b90a753b809dd1aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43361 } } peers { permanent_uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 44195 } }
I20260808 07:08:02.281383 17369 leader_election.cc:288] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 155303d877494643b90a753b809dd1aa (127.29.82.65:43361), 63b4e64ac6664b4f8470cdbae6d7e6fb (127.29.82.67:44195)
I20260808 07:08:02.285746 17355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:02.281184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:59207 (local address 127.29.82.67:44195)
0808 07:08:02.281282 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:02.281284 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:02.281691 (+ 407us) server_negotiation.cc:407] Connection header received
0808 07:08:02.281784 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:02.281785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:02.281795 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:02.281823 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:02.282230 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.282990 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.284492 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.285111 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.285210 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:02.285236 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:02.285611 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 07:08:02.285665 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 07:08:02.285746 17356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:02.281168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:46099 (local address 127.29.82.65:43361)
0808 07:08:02.281242 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:02.281245 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:02.281618 (+ 373us) server_negotiation.cc:407] Connection header received
0808 07:08:02.281736 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:02.281737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:02.281748 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:02.281779 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:02.282230 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.282982 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.284652 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.285254 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.285297 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:02.285305 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:02.285627 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 07:08:02.285673 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 07:08:02.286229 17371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:02.280931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:43361 (local address 127.29.82.66:46099)
0808 07:08:02.281535 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:02.281547 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:02.281652 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:02.281854 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:02.281854 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:02.281856 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:02.282089 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:02.282092 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.283083 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.283084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:02.284554 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:02.284557 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.285399 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.285400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:02.285544 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:02.285547 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:08:02.285910 (+ 363us) client_negotiation.cc:240] Negotiation successful
0808 07:08:02.285957 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"mutex_wait_us":8,"thread_start_us":397,"threads_started":1}
I20260808 07:08:02.286300 17372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:02.280931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:44195 (local address 127.29.82.66:59207)
0808 07:08:02.281633 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:02.281642 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:02.281715 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:02.281880 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:02.281881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:02.281882 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:02.282121 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:02.282122 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.283083 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.283084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:02.284368 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:02.284371 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.285396 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.285398 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:02.285513 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:02.285518 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:08:02.286108 (+ 590us) client_negotiation.cc:240] Negotiation successful
0808 07:08:02.286152 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"mutex_wait_us":35,"thread_start_us":426,"threads_started":1}
I20260808 07:08:02.286867 16812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704e0229ec584f3c95a09534b86d4276" candidate_uuid: "dcbed4a893544e3ab55b07e024d150cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155303d877494643b90a753b809dd1aa" is_pre_election: true
I20260808 07:08:02.286981 17214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704e0229ec584f3c95a09534b86d4276" candidate_uuid: "dcbed4a893544e3ab55b07e024d150cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb" is_pre_election: true
I20260808 07:08:02.287086 16812 raft_consensus.cc:2454] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcbed4a893544e3ab55b07e024d150cd in term 0.
I20260808 07:08:02.287151 17214 raft_consensus.cc:2454] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcbed4a893544e3ab55b07e024d150cd in term 0.
I20260808 07:08:02.287356 16928 leader_election.cc:302] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b4e64ac6664b4f8470cdbae6d7e6fb, dcbed4a893544e3ab55b07e024d150cd; no voters:
I20260808 07:08:02.287531 17369 raft_consensus.cc:2781] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:08:02.287581 17369 raft_consensus.cc:482] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:08:02.287601 17369 raft_consensus.cc:3037] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:02.288329 17369 raft_consensus.cc:504] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbed4a893544e3ab55b07e024d150cd" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44171 } } peers { permanent_uuid: "155303d877494643b90a753b809dd1aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43361 } } peers { permanent_uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 44195 } }
I20260808 07:08:02.288443 17369 leader_election.cc:288] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [CANDIDATE]: Term 1 election: Requested vote from peers 155303d877494643b90a753b809dd1aa (127.29.82.65:43361), 63b4e64ac6664b4f8470cdbae6d7e6fb (127.29.82.67:44195)
I20260808 07:08:02.288633 17214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704e0229ec584f3c95a09534b86d4276" candidate_uuid: "dcbed4a893544e3ab55b07e024d150cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb"
I20260808 07:08:02.288691 16812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704e0229ec584f3c95a09534b86d4276" candidate_uuid: "dcbed4a893544e3ab55b07e024d150cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "155303d877494643b90a753b809dd1aa"
I20260808 07:08:02.288707 17214 raft_consensus.cc:3037] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:02.288751 16812 raft_consensus.cc:3037] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:02.289682 17214 raft_consensus.cc:2454] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcbed4a893544e3ab55b07e024d150cd in term 1.
I20260808 07:08:02.289825 16812 raft_consensus.cc:2454] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcbed4a893544e3ab55b07e024d150cd in term 1.
I20260808 07:08:02.289901 16928 leader_election.cc:302] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63b4e64ac6664b4f8470cdbae6d7e6fb, dcbed4a893544e3ab55b07e024d150cd; no voters:
I20260808 07:08:02.290004 17369 raft_consensus.cc:2781] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:08:02.290164 17369 raft_consensus.cc:686] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [term 1 LEADER]: Becoming Leader. State: Replica: dcbed4a893544e3ab55b07e024d150cd, State: Running, Role: LEADER
I20260808 07:08:02.290261 17369 consensus_queue.cc:237] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbed4a893544e3ab55b07e024d150cd" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44171 } } peers { permanent_uuid: "155303d877494643b90a753b809dd1aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43361 } } peers { permanent_uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 44195 } }
I20260808 07:08:02.291131 16598 catalog_manager.cc:5495] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd reported cstate change: term changed from 0 to 1, leader changed from <none> to dcbed4a893544e3ab55b07e024d150cd (127.29.82.66). New cstate: current_term: 1 leader_uuid: "dcbed4a893544e3ab55b07e024d150cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbed4a893544e3ab55b07e024d150cd" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155303d877494643b90a753b809dd1aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 44195 } health_report { overall_health: UNKNOWN } } }
W20260808 07:08:02.291854 16893 tablet.cc:2369] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:08:02.314970 17353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:02.312425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47074 (local address 127.29.82.66:44171)
0808 07:08:02.312478 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:02.312480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:02.312520 (+ 40us) server_negotiation.cc:407] Connection header received
0808 07:08:02.312603 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:02.312604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:02.312632 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:02.312696 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:08:02.312824 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.313386 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.314141 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:02.314372 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:02.314430 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:02.314595 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:08:02.314713 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:08:02.314799 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:02.314817 (+ 18us) server_negotiation.cc:299] Negotiation successful
0808 07:08:02.314842 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 07:08:02.317648 17214 raft_consensus.cc:1261] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb [term 1 FOLLOWER]: Refusing update from remote peer dcbed4a893544e3ab55b07e024d150cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:08:02.317693 16812 raft_consensus.cc:1261] T 704e0229ec584f3c95a09534b86d4276 P 155303d877494643b90a753b809dd1aa [term 1 FOLLOWER]: Refusing update from remote peer dcbed4a893544e3ab55b07e024d150cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:08:02.318152 17374 consensus_queue.cc:1035] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155303d877494643b90a753b809dd1aa" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 43361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:08:02.318344 17369 consensus_queue.cc:1035] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "63b4e64ac6664b4f8470cdbae6d7e6fb" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 44195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:08:02.322808 17377 mvcc.cc:205] Tried to move back new op lower bound from 7316164125969842176 to 7316164125861629952. Current Snapshot: MvccSnapshot[applied={T|T < 7316164125969842176}]
I20260808 07:08:02.326593 16598 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:08:02.326715 16598 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:08:02.326870 17378 mvcc.cc:205] Tried to move back new op lower bound from 7316164125969842176 to 7316164125861629952. Current Snapshot: MvccSnapshot[applied={T|T < 7316164125969842176}]
I20260808 07:08:02.328056 16598 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7770ddb407974aab95e88df824b71804: Sending DeleteTablet for 3 replicas of tablet 704e0229ec584f3c95a09534b86d4276
I20260808 07:08:02.328650 16799 tablet_service.cc:1514] Processing DeleteTablet for tablet 704e0229ec584f3c95a09534b86d4276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:02 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:33038
I20260808 07:08:02.328752 17191 tablet_service.cc:1514] Processing DeleteTablet for tablet 704e0229ec584f3c95a09534b86d4276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:02 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:47830
I20260808 07:08:02.329145 16984 tablet_service.cc:1514] Processing DeleteTablet for tablet 704e0229ec584f3c95a09534b86d4276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:02 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:47070
I20260808 07:08:02.329516 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 16655
I20260808 07:08:02.335860 17392 tablet_replica.cc:330] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd: stopping tablet replica
I20260808 07:08:02.336017 17392 raft_consensus.cc:2229] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:08:02.336117 17392 raft_consensus.cc:2258] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:02.337180 17391 tablet_replica.cc:330] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb: stopping tablet replica
I20260808 07:08:02.337297 17391 raft_consensus.cc:2229] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:08:02.337400 17391 raft_consensus.cc:2258] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:02.339165 17391 ts_tablet_manager.cc:1905] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:08:02.339166 17392 ts_tablet_manager.cc:1905] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:08:02.341259 17392 ts_tablet_manager.cc:1918] T 704e0229ec584f3c95a09534b86d4276 P dcbed4a893544e3ab55b07e024d150cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260808 07:08:02.347059 16577 connection.cc:535] server connection from 127.29.82.65:53703 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:08:02.347337 17391 ts_tablet_manager.cc:1918] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260808 07:08:02.347399 16577 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:43361 (error 108)
I20260808 07:08:02.347563 17391 log.cc:1196] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/704e0229ec584f3c95a09534b86d4276
I20260808 07:08:02.347848 17391 ts_tablet_manager.cc:1939] T 704e0229ec584f3c95a09534b86d4276 P 63b4e64ac6664b4f8470cdbae6d7e6fb: Deleting consensus metadata
I20260808 07:08:02.348284 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 16897
I20260808 07:08:02.348454 16574 catalog_manager.cc:4841] TS 63b4e64ac6664b4f8470cdbae6d7e6fb (127.29.82.67:44195): tablet 704e0229ec584f3c95a09534b86d4276 (table test-table [id=5e8cb9c405ab499bb27813314041a5ac]) successfully deleted
I20260808 07:08:02.366425 17347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:02.366203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:43361 (local address 127.0.0.1:33048)
0808 07:08:02.366294 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:02.366364 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:43361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 07:08:02.366725 16577 catalog_manager.cc:4584] TS 155303d877494643b90a753b809dd1aa (127.29.82.65:43361): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 704e0229ec584f3c95a09534b86d4276: Network error: Client connection negotiation failed: client connection to 127.29.82.65:43361: connect: Connection refused (error 111)
W20260808 07:08:02.380897 17347 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:08:02.380495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:44171 (local address 127.0.0.1:47088)
0808 07:08:02.380560 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:02.380572 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:02.380620 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:02.380839 (+ 219us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.66:44171: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 07:08:02.381644 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 17093
I20260808 07:08:02.396507 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 16546
I20260808 07:08:02.418366 30025 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 07:08:02.763478 30025 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 07:08:02.763579 30025 mini_ranger.cc:66] Stopping Ranger...
I20260808 07:08:03.109200 30025 mini_ranger.cc:68] Stopped Ranger
2026-08-08 07:08:03.109 UTC [15180] LOG: received smart shutdown request
2026-08-08 07:08:03.113 UTC [15180] LOG: background worker "logical replication launcher" (PID 15191) exited with exit code 1
2026-08-08 07:08:03.114 UTC [15185] LOG: shutting down
2026-08-08 07:08:03.258 UTC [15180] LOG: database system is shut down
2026-08-08T07:08:03Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47791 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:08:03 dist-test-slave-rmhg krb5kdc[17409](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:08:03 dist-test-slave-rmhg krb5kdc[17409](info): set up 2 sockets
Aug 08 07:08:03 dist-test-slave-rmhg krb5kdc[17409](info): commencing operation
krb5kdc: starting...
W20260808 07:08:04.475234 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:08:04 dist-test-slave-rmhg krb5kdc[17409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:08:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:08:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:08:04.601217 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:42135
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:35937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:42135,127.29.82.125:33097,127.29.82.124:32975
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:04.684757 17431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:04.684979 17431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:04.685009 17431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:04.686203 17431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:08:04.686245 17431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:04.686264 17431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:04.686278 17431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:08:04.686293 17431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:08:04.688323 17431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:35937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:42135,127.29.82.125:33097,127.29.82.124:32975
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:42135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:04.688673 17431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:04.688925 17431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:04.693787 17441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:04.693933 17431 server_base.cc:1034] running on GCE node
W20260808 07:08:04.693795 17438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:04.693794 17445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:04.694243 17431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:04.694527 17431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:04.695701 17431 hybrid_clock.cc:648] HybridClock initialized: now 1786172884695658 us; error 57 us; skew 500 ppm
Aug 08 07:08:04 dist-test-slave-rmhg krb5kdc[17409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172884, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:04.698428 17431 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:08:04.698923 17431 webserver.cc:460] Webserver started at http://127.29.82.126:41919/ using document root <none> and password file <none>
I20260808 07:08:04.699152 17431 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:04.699201 17431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:04.699331 17431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:08:04.700388 17431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "4347f5c583264cfc8fedeec14a77e7d7"
format_stamp: "Formatted at 2026-08-08 07:08:04 on dist-test-slave-rmhg"
server_key: "d05f559588f50e1a884b06fedb57911b"
server_key_iv: "f3a6d4f42e68cb43697d4388d3231878"
server_key_version: "encryptionkey@0"
I20260808 07:08:04.700740 17431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "4347f5c583264cfc8fedeec14a77e7d7"
format_stamp: "Formatted at 2026-08-08 07:08:04 on dist-test-slave-rmhg"
server_key: "d05f559588f50e1a884b06fedb57911b"
server_key_iv: "f3a6d4f42e68cb43697d4388d3231878"
server_key_version: "encryptionkey@0"
I20260808 07:08:04.702077 17431 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:08:04.702842 17456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:04.703002 17431 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:08:04.703099 17431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "4347f5c583264cfc8fedeec14a77e7d7"
format_stamp: "Formatted at 2026-08-08 07:08:04 on dist-test-slave-rmhg"
server_key: "d05f559588f50e1a884b06fedb57911b"
server_key_iv: "f3a6d4f42e68cb43697d4388d3231878"
server_key_version: "encryptionkey@0"
I20260808 07:08:04.703166 17431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:04.714564 17431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:04.716584 17431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:04.716744 17431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:04.721014 17431 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:42135
I20260808 07:08:04.721052 17532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:42135 every 8 connection(s)
I20260808 07:08:04.721470 17431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:08:04.722368 17533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:04.723992 17533 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:08:04.727036 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 17431
I20260808 07:08:04.727156 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:08:04.727381 30025 external_mini_cluster.cc:1428] Setting key fa757fbfa2df2430a2612cd4f17dbb31
Aug 08 07:08:04 dist-test-slave-rmhg krb5kdc[17409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172884, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:04.734947 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.724759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:42135 (local address 127.0.0.1:37144)
0808 07:08:04.724952 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.724991 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:04.725508 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:04.725809 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:04.725813 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:04.726091 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:04.726261 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:04.726266 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.727366 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.727367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:04.728412 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:04.728415 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.728962 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.728963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:04.729045 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:04.729767 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:04.729776 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:04.731257 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:04.733291 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:04.733301 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:04.733303 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:04.733510 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:04.733786 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:04.733787 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:04.733787 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:04.733862 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:04.734313 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:04.734320 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:04.734389 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 07:08:04.734517 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 07:08:04.734764 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":105,"thread_start_us":74,"threads_started":1}
I20260808 07:08:04.734954 17536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.724930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37144 (local address 127.29.82.126:42135)
0808 07:08:04.725060 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:04.725066 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:04.725095 (+ 29us) server_negotiation.cc:407] Connection header received
0808 07:08:04.725652 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:04.725654 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:04.725673 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:04.725750 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:04.726384 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.727264 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.728520 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.728869 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.728970 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:04.731350 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:04.731359 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:04.731359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:04.731366 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:04.733204 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:04.733604 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:04.733608 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:04.733608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:04.733722 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:04.733915 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:04.733916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:04.733916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:04.734223 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:04.734316 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:04.734534 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 07:08:04.734704 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":13,"server-negotiator.queue_time_us":93,"thread_start_us":45,"threads_started":1}
I20260808 07:08:04.735729 17533 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:08:04.736111 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.735995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33097 (local address 127.0.0.1:40262)
0808 07:08:04.736046 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.736091 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:33097: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
WARNING: no policy specified for kudu/127.29.82.125@KRBTEST.COM; defaulting to no policy
W20260808 07:08:04.736230 17459 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.82.125:33097: connect: Connection refused (error 111)
I20260808 07:08:04.736680 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.736587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33097 (local address 127.0.0.1:40278)
0808 07:08:04.736633 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.736658 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:33097: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 07:08:04.736797 17533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.125:33097: Network error: Client connection negotiation failed: client connection to 127.29.82.125:33097: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.125.keytab.
Entry for principal kudu/127.29.82.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.125.keytab.
I20260808 07:08:04.757074 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.125:33097
--webserver_interface=127.29.82.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.125.keytab
--principal=kudu/127.29.82.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:35937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:42135,127.29.82.125:33097,127.29.82.124:32975
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:08:04.786048 17533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } attempt: 1
I20260808 07:08:04.786567 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.786442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33097 (local address 127.0.0.1:40282)
0808 07:08:04.786499 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.786534 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:33097: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 07:08:04.786978 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.786881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33097 (local address 127.0.0.1:40284)
0808 07:08:04.786926 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.786953 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:33097: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 07:08:04.787065 17533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.125:33097: Network error: Client connection negotiation failed: client connection to 127.29.82.125:33097: connect: Connection refused (error 111)
W20260808 07:08:04.841231 17540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:04.841459 17540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:04.841490 17540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:04.842698 17540 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:08:04.842751 17540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:04.842768 17540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:04.842784 17540 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:08:04.842799 17540 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:08:04.844507 17540 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:35937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:42135,127.29.82.125:33097,127.29.82.124:32975
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.125.keytab
--principal=kudu/127.29.82.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.125:33097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.82.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:04.844806 17540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:04.845041 17540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:04.850051 17551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:04.850054 17546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:04.850064 17548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:04.850276 17540 server_base.cc:1034] running on GCE node
I20260808 07:08:04.850591 17540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:04.850904 17540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:04.852078 17540 hybrid_clock.cc:648] HybridClock initialized: now 1786172884852064 us; error 32 us; skew 500 ppm
Aug 08 07:08:04 dist-test-slave-rmhg krb5kdc[17409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172884, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:04.854758 17540 init.cc:377] Logged in from keytab as kudu/127.29.82.125@KRBTEST.COM (short username kudu)
I20260808 07:08:04.855242 17540 webserver.cc:460] Webserver started at http://127.29.82.125:40199/ using document root <none> and password file <none>
I20260808 07:08:04.855212 17533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } attempt: 2
I20260808 07:08:04.855489 17540 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:04.855553 17540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:04.855613 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.855475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33097 (local address 127.0.0.1:40292)
0808 07:08:04.855541 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.855580 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:33097: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 07:08:04.855695 17540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:08:04.855933 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.855838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33097 (local address 127.0.0.1:40300)
0808 07:08:04.855881 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.855908 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:33097: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 07:08:04.856087 17533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.125:33097: Network error: Client connection negotiation failed: client connection to 127.29.82.125:33097: connect: Connection refused (error 111)
I20260808 07:08:04.856875 17540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/data/instance:
uuid: "e127a8374fbf4930a583f6d59ced1bbc"
format_stamp: "Formatted at 2026-08-08 07:08:04 on dist-test-slave-rmhg"
server_key: "4cf52829a58155e759154a9e5c9b6253"
server_key_iv: "e7f3cca29d4cbe9b2ad9b0b0e0542892"
server_key_version: "encryptionkey@0"
I20260808 07:08:04.857312 17540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/wal/instance:
uuid: "e127a8374fbf4930a583f6d59ced1bbc"
format_stamp: "Formatted at 2026-08-08 07:08:04 on dist-test-slave-rmhg"
server_key: "4cf52829a58155e759154a9e5c9b6253"
server_key_iv: "e7f3cca29d4cbe9b2ad9b0b0e0542892"
server_key_version: "encryptionkey@0"
I20260808 07:08:04.858697 17540 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:08:04.859634 17563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:04.859838 17540 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:08:04.859956 17540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/wal
uuid: "e127a8374fbf4930a583f6d59ced1bbc"
format_stamp: "Formatted at 2026-08-08 07:08:04 on dist-test-slave-rmhg"
server_key: "4cf52829a58155e759154a9e5c9b6253"
server_key_iv: "e7f3cca29d4cbe9b2ad9b0b0e0542892"
server_key_version: "encryptionkey@0"
I20260808 07:08:04.860024 17540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:04.869796 17540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:04.872011 17540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:04.872139 17540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:04.876223 17540 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.125:33097
I20260808 07:08:04.876264 17636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.125:33097 every 8 connection(s)
I20260808 07:08:04.876590 17540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/data/info.pb
I20260808 07:08:04.877563 17637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:04.879096 17637 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:08:04.882911 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 17540
I20260808 07:08:04.883024 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-1/wal/instance
I20260808 07:08:04.883235 30025 external_mini_cluster.cc:1428] Setting key 66df02038fab7fcd733f60b476b14879
Aug 08 07:08:04 dist-test-slave-rmhg krb5kdc[17409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172884, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.125@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:04.888631 17536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.879858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37154 (local address 127.29.82.126:42135)
0808 07:08:04.879920 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:04.879923 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:04.880110 (+ 187us) server_negotiation.cc:407] Connection header received
0808 07:08:04.880638 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:04.880640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:04.880655 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:04.880709 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:04.881386 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.881861 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.882853 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.883070 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.883134 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:04.885708 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:04.885709 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:04.885710 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:04.885717 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:04.887058 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:04.887592 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:04.887593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:04.887594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:04.887662 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:04.887938 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:04.887939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:04.887939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:04.888058 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:04.888107 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:04.888438 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 07:08:04.888535 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:08:04.888803 17640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.879785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:42135 (local address 127.0.0.1:37154)
0808 07:08:04.879985 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.880023 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:04.880529 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:04.880788 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:04.880792 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:04.881045 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:04.881290 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:04.881295 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.881945 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.881947 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:04.882765 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:04.882767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.883153 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.883155 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:04.883333 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:04.883837 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:04.883850 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:04.885590 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:04.887142 (+ 1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:04.887150 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:04.887152 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:04.887505 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:04.887727 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:04.887728 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:04.887728 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:04.887873 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:04.888115 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:04.888121 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:04.888290 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 07:08:04.888400 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 07:08:04.888578 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":95,"threads_started":1}
I20260808 07:08:04.889357 17637 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.29.82.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.124@KRBTEST.COM" created.
Aug 08 07:08:04 dist-test-slave-rmhg krb5kdc[17409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172884, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.125@KRBTEST.COM for kudu/127.29.82.125@KRBTEST.COM
I20260808 07:08:04.898340 17640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.889623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33097 (local address 127.0.0.1:40312)
0808 07:08:04.889677 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.889688 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:04.889735 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:04.890017 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:04.890018 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:04.890129 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:04.890188 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:04.890190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.891476 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.891477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:04.891991 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:04.891992 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.892449 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.892451 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:04.892518 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:04.893008 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:04.893013 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:04.895349 (+ 2336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:04.897245 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:04.897246 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:04.897247 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:04.897416 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:04.897657 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:04.897658 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:04.897658 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:04.897710 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:04.898049 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:04.898050 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:04.898095 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 07:08:04.898163 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 07:08:04.898258 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 07:08:04.898445 17644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.889673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40312 (local address 127.29.82.125:33097)
0808 07:08:04.889845 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:04.889851 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:04.889877 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:08:04.889900 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:04.889902 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:04.889918 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:04.890003 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:04.890263 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.891374 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.892076 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.892380 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.892432 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:04.895429 (+ 2997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:04.895439 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:04.895440 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:04.895453 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:04.897119 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:04.897502 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:04.897507 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:04.897507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:04.897575 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:04.897759 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:04.897760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:04.897760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:04.897963 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:04.898048 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:04.898209 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 07:08:04.898324 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":138,"thread_start_us":96,"threads_started":1}
I20260808 07:08:04.899072 17637 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:08:04.899394 17640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.899286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:32975 (local address 127.0.0.1:39292)
0808 07:08:04.899328 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.899374 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 07:08:04.899576 17568 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
I20260808 07:08:04.899982 17640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.899897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:32975 (local address 127.0.0.1:39300)
0808 07:08:04.899933 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.899959 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 07:08:04.900085 17637 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:32975: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.124.keytab.
Entry for principal kudu/127.29.82.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.124.keytab.
I20260808 07:08:04.911480 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.124:32975
--webserver_interface=127.29.82.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.124.keytab
--principal=kudu/127.29.82.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:35937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:42135,127.29.82.125:33097,127.29.82.124:32975
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:08:04.947273 17533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } attempt: 3
I20260808 07:08:04.949291 17637 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } attempt: 1
I20260808 07:08:04.949740 17640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.949581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:32975 (local address 127.0.0.1:39304)
0808 07:08:04.949643 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.949696 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 07:08:04.950091 17640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.949991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:32975 (local address 127.0.0.1:39314)
0808 07:08:04.950033 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.950063 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 07:08:04.950187 17637 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:32975: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
Aug 08 07:08:04 dist-test-slave-rmhg krb5kdc[17409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172884, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for kudu/127.29.82.125@KRBTEST.COM
I20260808 07:08:04.954329 17644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.947758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40328 (local address 127.29.82.125:33097)
0808 07:08:04.947837 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:04.947839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:04.947849 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:08:04.947877 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:04.947878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:04.947892 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:04.947935 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:04.948302 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.948817 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.949681 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.950096 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.950247 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:04.952094 (+ 1847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:04.952096 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:04.952096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:04.952104 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:04.953339 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:04.953642 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:04.953643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:04.953644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:04.953696 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:04.953855 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:04.953856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:04.953856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:04.953969 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:04.954025 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:04.954160 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 07:08:04.954236 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 07:08:04.954334 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.947675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33097 (local address 127.0.0.1:40328)
0808 07:08:04.947745 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.947756 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:04.947804 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:04.947962 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:04.947963 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:04.948141 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:04.948219 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:04.948221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.948895 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.948897 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:04.949605 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:04.949609 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:04.950199 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:04.950201 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:04.950287 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:04.950778 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:04.950783 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:04.952014 (+ 1231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:04.953416 (+ 1402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:04.953417 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:04.953418 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:04.953582 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:04.953750 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:04.953751 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:04.953751 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:04.953807 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:04.954023 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:04.954024 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:04.954074 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 07:08:04.954132 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:08:04.954236 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 07:08:04.954794 17533 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:08:04.955119 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.955028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:32975 (local address 127.0.0.1:39316)
0808 07:08:04.955071 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.955099 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 07:08:04.955435 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.955349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:32975 (local address 127.0.0.1:39330)
0808 07:08:04.955392 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.955414 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 07:08:04.955513 17533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:32975: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
I20260808 07:08:04.986683 17533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } attempt: 1
I20260808 07:08:04.987241 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.987085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:32975 (local address 127.0.0.1:39338)
0808 07:08:04.987159 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.987206 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 07:08:04.987618 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:04.987531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:32975 (local address 127.0.0.1:39354)
0808 07:08:04.987575 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:04.987600 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 07:08:04.987718 17533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:32975: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
W20260808 07:08:04.998260 17648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:04.998497 17648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:04.998522 17648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:04.999774 17648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:08:04.999825 17648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:04.999838 17648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:04.999850 17648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:08:04.999861 17648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:08:05.001587 17648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:35937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:42135,127.29.82.125:33097,127.29.82.124:32975
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.124.keytab
--principal=kudu/127.29.82.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.124:32975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.82.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:05.001874 17648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:05.002087 17648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:05.007114 17657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:05.007117 17656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:05.007158 17659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:05.007382 17648 server_base.cc:1034] running on GCE node
I20260808 07:08:05.007633 17648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:05.007936 17648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:05.009083 17648 hybrid_clock.cc:648] HybridClock initialized: now 1786172885009065 us; error 38 us; skew 500 ppm
Aug 08 07:08:05 dist-test-slave-rmhg krb5kdc[17409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172885, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:05.011746 17648 init.cc:377] Logged in from keytab as kudu/127.29.82.124@KRBTEST.COM (short username kudu)
I20260808 07:08:05.012213 17648 webserver.cc:460] Webserver started at http://127.29.82.124:44609/ using document root <none> and password file <none>
I20260808 07:08:05.012450 17648 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:05.012512 17648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:05.012637 17648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:08:05.013759 17648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/data/instance:
uuid: "fdc0f144fb5f45538beba88b754f7e2a"
format_stamp: "Formatted at 2026-08-08 07:08:05 on dist-test-slave-rmhg"
server_key: "c482a932defe3a8b3b6e0fa7180de2c5"
server_key_iv: "d12c9e27de66852986a1bf5916144dbc"
server_key_version: "encryptionkey@0"
I20260808 07:08:05.014125 17648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/wal/instance:
uuid: "fdc0f144fb5f45538beba88b754f7e2a"
format_stamp: "Formatted at 2026-08-08 07:08:05 on dist-test-slave-rmhg"
server_key: "c482a932defe3a8b3b6e0fa7180de2c5"
server_key_iv: "d12c9e27de66852986a1bf5916144dbc"
server_key_version: "encryptionkey@0"
I20260808 07:08:05.015506 17648 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:08:05.016368 17668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:05.016606 17648 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:05.016700 17648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/wal
uuid: "fdc0f144fb5f45538beba88b754f7e2a"
format_stamp: "Formatted at 2026-08-08 07:08:05 on dist-test-slave-rmhg"
server_key: "c482a932defe3a8b3b6e0fa7180de2c5"
server_key_iv: "d12c9e27de66852986a1bf5916144dbc"
server_key_version: "encryptionkey@0"
I20260808 07:08:05.016764 17648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:05.018342 17637 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } attempt: 2
I20260808 07:08:05.018824 17640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.018701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:32975 (local address 127.0.0.1:39360)
0808 07:08:05.018756 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:05.018795 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 07:08:05.019237 17640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.019123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:32975 (local address 127.0.0.1:39362)
0808 07:08:05.019188 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:05.019213 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 07:08:05.019335 17637 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:32975: Network error: Client connection negotiation failed: client connection to 127.29.82.124:32975: connect: Connection refused (error 111)
I20260808 07:08:05.040521 17648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:05.042791 17648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:05.042941 17648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:05.047049 17648 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.124:32975
I20260808 07:08:05.047080 17739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.124:32975 every 8 connection(s)
I20260808 07:08:05.047432 17648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/data/info.pb
I20260808 07:08:05.047904 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 17648
I20260808 07:08:05.048025 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172701750152-30025-0/minicluster-data/master-2/wal/instance
I20260808 07:08:05.048242 30025 external_mini_cluster.cc:1428] Setting key eea88318f4d410a11144258d3227c8ef
I20260808 07:08:05.048535 17740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:05.050952 17740 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:08:05 dist-test-slave-rmhg krb5kdc[17409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.124@KRBTEST.COM
Aug 08 07:08:05 dist-test-slave-rmhg krb5kdc[17409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172885, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.124@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:05.058888 17536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.051655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37170 (local address 127.29.82.126:42135)
0808 07:08:05.051709 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:05.051712 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:05.051854 (+ 142us) server_negotiation.cc:407] Connection header received
0808 07:08:05.051911 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:05.051912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:05.051922 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:05.051977 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:05.052394 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.052965 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.053790 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.053984 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.054042 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.056380 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:05.056382 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:05.056382 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:05.056390 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:05.057793 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.058141 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.058142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.058143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.058196 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.058357 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.058357 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.058358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.058464 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:05.058519 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:05.058706 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 07:08:05.058792 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:08:05.059094 17747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.051603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:42135 (local address 127.0.0.1:37170)
0808 07:08:05.051760 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:05.051794 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:05.051860 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:05.051997 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:05.052000 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:05.052259 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:05.052320 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:05.052321 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.053054 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.053055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:05.053709 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:05.053712 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.054055 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.054056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:05.054137 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.054576 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:05.054584 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:05.056294 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:05.057869 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:05.057876 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:05.057879 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:05.058075 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:05.058250 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:05.058251 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:05.058251 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:05.058307 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:05.058518 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:05.058526 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:05.058595 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 07:08:05.058669 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 07:08:05.058901 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":106,"thread_start_us":88,"threads_started":1}
I20260808 07:08:05.059099 17746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.048829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39374 (local address 127.29.82.124:32975)
0808 07:08:05.048995 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:05.049004 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:05.049038 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:08:05.049737 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:05.049746 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:05.049801 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:05.049938 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:05.050709 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.051848 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.052760 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.053245 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.053364 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.055843 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:05.055851 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:05.055851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:05.055858 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:05.057549 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.057877 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.057880 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.057881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.058009 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.058185 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.058186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.058187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.058417 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:05.058536 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:05.058648 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 07:08:05.058837 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":118,"thread_start_us":75,"threads_started":1}
I20260808 07:08:05.060084 17740 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:08:05.062841 17533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } attempt: 2
Aug 08 07:08:05 dist-test-slave-rmhg krb5kdc[17409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172885, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.124@KRBTEST.COM for kudu/127.29.82.125@KRBTEST.COM
Aug 08 07:08:05 dist-test-slave-rmhg krb5kdc[17409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
Aug 08 07:08:05 dist-test-slave-rmhg krb5kdc[17409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172884, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for kudu/127.29.82.124@KRBTEST.COM
I20260808 07:08:05.067692 17644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.060387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40336 (local address 127.29.82.125:33097)
0808 07:08:05.060429 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:05.060431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:05.060439 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:08:05.060466 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:05.060467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:05.060475 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:05.060514 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:05.060769 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.061277 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.061889 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.062089 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.062145 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.064845 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:05.064847 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:05.064848 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:05.064855 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:05.066707 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.067002 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.067003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.067004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.067058 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.067223 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.067224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.067224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.067331 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:05.067386 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:05.067520 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 07:08:05.067586 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:08:05.067692 17747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.060325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:33097 (local address 127.0.0.1:40336)
0808 07:08:05.060372 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:05.060382 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:05.060422 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:05.060523 (+ 101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:05.060524 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:05.060659 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:05.060692 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:05.060694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.061347 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.061348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:05.061821 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:05.061823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.062146 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.062146 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:05.062199 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.062593 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:05.062598 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:05.064746 (+ 2148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:05.066784 (+ 2038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:05.066785 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:05.066785 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:05.066939 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:05.067118 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:05.067118 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:05.067119 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:05.067174 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:05.067385 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:05.067386 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:05.067427 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 07:08:05.067491 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 07:08:05.067585 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 07:08:05.067865 17536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.059904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37172 (local address 127.29.82.126:42135)
0808 07:08:05.059943 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:05.059944 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:05.059983 (+ 39us) server_negotiation.cc:407] Connection header received
0808 07:08:05.060031 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:05.060032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:05.060041 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:05.060086 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:05.060642 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.061082 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.061750 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.061944 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.061998 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.064886 (+ 2888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:05.064887 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:05.064888 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:05.064895 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:05.066535 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.066903 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.066904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.066904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.066953 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.067151 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.067152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.067152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.067275 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:05.067449 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:05.067681 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 07:08:05.067764 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:08:05.068048 17740 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:08:05.071168 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.063135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:32975 (local address 127.0.0.1:39378)
0808 07:08:05.063227 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:05.063236 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:05.063279 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:05.063424 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:05.063425 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:05.063592 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:05.063630 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:05.063631 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.064561 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.064563 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:05.065280 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:05.065284 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.065744 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.065745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:05.065810 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.066639 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:05.066644 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:05.068325 (+ 1681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:05.070011 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:05.070012 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:05.070013 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:05.070213 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:05.070399 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:05.070400 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:05.070400 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:05.070461 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:05.070736 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:05.070737 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:05.070813 (+ 76us) client_negotiation.cc:769] Sending connection context
0808 07:08:05.070905 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 07:08:05.071053 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 07:08:05.071198 17746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.063190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39378 (local address 127.29.82.124:32975)
0808 07:08:05.063225 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:05.063227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:05.063321 (+ 94us) server_negotiation.cc:407] Connection header received
0808 07:08:05.063339 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:05.063340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:05.063349 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:05.063399 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:05.063704 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.064464 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.065383 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.065679 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.065742 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.068410 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:05.068412 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:05.068412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:05.068418 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:05.069931 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.070279 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.070280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.070280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.070339 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.070539 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.070540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.070540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.070664 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:05.070725 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:05.071030 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 07:08:05.071111 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Aug 08 07:08:05 dist-test-slave-rmhg krb5kdc[17409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172885, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.124@KRBTEST.COM for kudu/127.29.82.124@KRBTEST.COM
I20260808 07:08:05.073302 17533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7: Bootstrap starting.
Aug 08 07:08:05 dist-test-slave-rmhg krb5kdc[17409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.125@KRBTEST.COM
I20260808 07:08:05.075026 17533 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:05.075359 17533 log.cc:824] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:05.075476 17747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.068335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:32975 (local address 127.0.0.1:39384)
0808 07:08:05.068363 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:05.068371 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:05.068403 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:05.068686 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:05.068687 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:05.068816 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:05.068848 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:05.068850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.070165 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.070165 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:05.070880 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:05.070882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.071346 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.071347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:05.071388 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.071766 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:05.071771 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:05.073053 (+ 1282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:05.074532 (+ 1479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:05.074532 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:05.074533 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:05.074688 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:05.074852 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:05.074852 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:05.074853 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:05.074903 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:05.075147 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:05.075148 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:05.075186 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 07:08:05.075247 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:08:05.075347 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14}
I20260808 07:08:05.075554 17748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.068405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39384 (local address 127.29.82.124:32975)
0808 07:08:05.068576 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:05.068578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:05.068583 (+ 5us) server_negotiation.cc:407] Connection header received
0808 07:08:05.068596 (+ 13us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:05.068597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:05.068615 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:05.068677 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:05.068938 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.070094 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.070954 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.071238 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.071299 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.073132 (+ 1833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:05.073133 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:05.073133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:05.073140 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:05.074460 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.074746 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.074747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.074747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.074800 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.074952 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.074953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.074953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.075082 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:05.075146 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:05.075274 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 07:08:05.075400 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":153,"thread_start_us":117,"threads_started":1}
I20260808 07:08:05.076287 17533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7: No bootstrap required, opened a new log
I20260808 07:08:05.076557 17644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.069033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40348 (local address 127.29.82.125:33097)
0808 07:08:05.069065 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:05.069066 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:05.069072 (+ 6us) server_negotiation.cc:407] Connection header received
0808 07:08:05.069089 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:05.069089 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:05.069096 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:05.069143 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:05.069762 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.070373 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.071192 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.071426 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.071457 (+ 31us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.073850 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:05.073851 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:05.073852 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:05.073859 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:05.075346 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.075737 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.075738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.075738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.075798 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.075971 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.075972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.075972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.076098 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:05.076214 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:05.076389 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 07:08:05.076469 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:08:05.076985 17740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a: Bootstrap starting.
I20260808 07:08:05.077761 17740 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:05.078037 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:08:05.078058 17740 log.cc:824] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:05.078455 17533 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } }
I20260808 07:08:05.078696 17533 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:05.078792 17533 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4347f5c583264cfc8fedeec14a77e7d7, State: Initialized, Role: FOLLOWER
I20260808 07:08:05.078909 17740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a: No bootstrap required, opened a new log
I20260808 07:08:05.078999 17533 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } }
I20260808 07:08:05.079324 17533 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:08:05.080101 17760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } } }
I20260808 07:08:05.080185 17760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:08:05.080924 17740 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } }
I20260808 07:08:05.081063 17740 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:05.081099 17740 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc0f144fb5f45538beba88b754f7e2a, State: Initialized, Role: FOLLOWER
W20260808 07:08:05.081386 17781 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:08:05.081477 17781 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:08:05.081447 17740 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } }
I20260808 07:08:05.081907 17740 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [sys.catalog]: configured and running, proceeding with master startup.
W20260808 07:08:05.083901 17805 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:08:05.084003 17805 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:08:05.084585 17785 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } } }
I20260808 07:08:05.084736 17785 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:08:05.082274 17431 master_runner.cc:186] Error getting master registration for 127.29.82.125:33097: OK, instance_id { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" instance_seqno: 1786172884875032 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:08:05.085526 17431 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:08:05.088092 17644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.079679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40350 (local address 127.29.82.125:33097)
0808 07:08:05.079714 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:05.079715 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:05.080375 (+ 660us) server_negotiation.cc:407] Connection header received
0808 07:08:05.080462 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:05.080463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:05.080472 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:05.080497 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:05.081139 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.081822 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.082791 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.083078 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.083121 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.085010 (+ 1889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:05.085011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:05.085011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:05.085019 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:05.086848 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.087220 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.087221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.087222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.087282 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.087480 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.087481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.087481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.087612 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:05.087704 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:05.087911 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 07:08:05.088000 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:08:05.086551 17648 master_runner.cc:186] Error getting master registration for 127.29.82.125:33097: OK, instance_id { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" instance_seqno: 1786172884875032 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:08:05.089058 17648 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:08:05.092417 17536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.079371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37178 (local address 127.29.82.126:42135)
0808 07:08:05.079410 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:05.079412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:05.079579 (+ 167us) server_negotiation.cc:407] Connection header received
0808 07:08:05.079674 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:05.079674 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:05.079684 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:05.079715 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:05.080420 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.081137 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.086837 (+ 5700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.087109 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.087152 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.089281 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:05.089283 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:05.089283 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:05.089291 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:05.090863 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.091288 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.091289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.091290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.091346 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.091540 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.091541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.091541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.091670 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:05.091752 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:05.092238 (+ 486us) server_negotiation.cc:299] Negotiation successful
0808 07:08:05.092320 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:08:05.096103 17748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.079851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39390 (local address 127.29.82.124:32975)
0808 07:08:05.080262 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:05.080263 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:05.088794 (+ 8531us) server_negotiation.cc:407] Connection header received
0808 07:08:05.088885 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:05.088886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:05.088900 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:05.088929 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:05.089462 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.090173 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.091250 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.091551 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.091594 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.093292 (+ 1698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:05.093293 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:05.093294 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:05.093301 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:05.094847 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.095240 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.095241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.095242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.095296 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.095488 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.095488 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.095489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.095620 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:05.095690 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:05.095903 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 07:08:05.096003 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389}
I20260808 07:08:05.110500 17637 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } attempt: 3
Aug 08 07:08:05 dist-test-slave-rmhg krb5kdc[17409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172884, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.125@KRBTEST.COM for kudu/127.29.82.124@KRBTEST.COM
I20260808 07:08:05.118829 17748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.110935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39402 (local address 127.29.82.124:32975)
0808 07:08:05.110984 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:05.110986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:05.111005 (+ 19us) server_negotiation.cc:407] Connection header received
0808 07:08:05.111028 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:05.111029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:05.111039 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:05.111089 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:05.111457 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.112270 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.113300 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.113620 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.113695 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.115981 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:05.115982 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:05.115983 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:05.115991 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:05.117627 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.118031 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.118032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.118032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.118095 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:05.118286 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:05.118286 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:05.118287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:05.118424 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:05.118489 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:05.118643 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 07:08:05.118729 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:08:05.118849 17640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:05.110854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:32975 (local address 127.0.0.1:39402)
0808 07:08:05.110915 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:05.110926 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:05.110964 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:05.111116 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:05.111118 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:05.111319 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:05.111375 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:05.111377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.112378 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.112380 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:05.113222 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:05.113225 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:05.113704 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:05.113705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:05.113771 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:05.114275 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:05.114281 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:05.115889 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:05.117727 (+ 1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:05.117729 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:05.117730 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:05.117958 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:05.118165 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:05.118166 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:05.118166 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:05.118231 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:05.118484 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:05.118485 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:05.118543 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 07:08:05.118610 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 07:08:05.118721 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 07:08:05.120944 17637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc: Bootstrap starting.
I20260808 07:08:05.121764 17637 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:05.122078 17637 log.cc:824] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:05.123039 17637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc: No bootstrap required, opened a new log
I20260808 07:08:05.125092 17637 raft_consensus.cc:348] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } }
I20260808 07:08:05.125288 17637 raft_consensus.cc:374] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:05.125379 17637 raft_consensus.cc:729] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e127a8374fbf4930a583f6d59ced1bbc, State: Initialized, Role: FOLLOWER
I20260808 07:08:05.125550 17637 consensus_queue.cc:260] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } }
I20260808 07:08:05.125898 17808 sys_catalog.cc:455] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } } }
I20260808 07:08:05.125989 17637 sys_catalog.cc:564] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:08:05.126075 17808 sys_catalog.cc:458] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:08:05.128082 17822 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:08:05.128202 17822 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:08:05.128536 17760 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:08:05.128635 17760 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } }
I20260808 07:08:05.128880 17760 leader_election.cc:288] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e127a8374fbf4930a583f6d59ced1bbc (127.29.82.125:33097), fdc0f144fb5f45538beba88b754f7e2a (127.29.82.124:32975)
I20260808 07:08:05.129189 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4347f5c583264cfc8fedeec14a77e7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e127a8374fbf4930a583f6d59ced1bbc" is_pre_election: true
I20260808 07:08:05.129319 17602 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4347f5c583264cfc8fedeec14a77e7d7 in term 0.
I20260808 07:08:05.129381 17704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4347f5c583264cfc8fedeec14a77e7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc0f144fb5f45538beba88b754f7e2a" is_pre_election: true
I20260808 07:08:05.129539 17704 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4347f5c583264cfc8fedeec14a77e7d7 in term 0.
I20260808 07:08:05.129802 17461 leader_election.cc:302] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4347f5c583264cfc8fedeec14a77e7d7, fdc0f144fb5f45538beba88b754f7e2a; no voters:
I20260808 07:08:05.129974 17760 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:08:05.130023 17760 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:08:05.130043 17760 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:05.130856 17540 master_runner.cc:263] No leader master found from master e127a8374fbf4930a583f6d59ced1bbc
I20260808 07:08:05.130898 17540 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:08:05.130992 17760 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } }
I20260808 07:08:05.131120 17760 leader_election.cc:288] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [CANDIDATE]: Term 1 election: Requested vote from peers e127a8374fbf4930a583f6d59ced1bbc (127.29.82.125:33097), fdc0f144fb5f45538beba88b754f7e2a (127.29.82.124:32975)
I20260808 07:08:05.131274 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4347f5c583264cfc8fedeec14a77e7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e127a8374fbf4930a583f6d59ced1bbc"
I20260808 07:08:05.131337 17602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:05.132377 17704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4347f5c583264cfc8fedeec14a77e7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc0f144fb5f45538beba88b754f7e2a"
I20260808 07:08:05.132453 17704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:05.132584 17602 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4347f5c583264cfc8fedeec14a77e7d7 in term 1.
I20260808 07:08:05.133212 17459 leader_election.cc:302] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4347f5c583264cfc8fedeec14a77e7d7, e127a8374fbf4930a583f6d59ced1bbc; no voters:
I20260808 07:08:05.133376 17760 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:08:05.133467 17704 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4347f5c583264cfc8fedeec14a77e7d7 in term 1.
I20260808 07:08:05.133780 17760 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [term 1 LEADER]: Becoming Leader. State: Replica: 4347f5c583264cfc8fedeec14a77e7d7, State: Running, Role: LEADER
I20260808 07:08:05.133878 17760 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } }
I20260808 07:08:05.134351 17824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4347f5c583264cfc8fedeec14a77e7d7. Latest consensus state: current_term: 1 leader_uuid: "4347f5c583264cfc8fedeec14a77e7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } } }
I20260808 07:08:05.134438 17824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:05.134716 17828 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:08:05.134989 17828 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:08:05.136701 17602 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [term 1 FOLLOWER]: Refusing update from remote peer 4347f5c583264cfc8fedeec14a77e7d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:08:05.136713 17704 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [term 1 FOLLOWER]: Refusing update from remote peer 4347f5c583264cfc8fedeec14a77e7d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:08:05.137038 17824 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:08:05.137185 17760 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:08:05.138523 17785 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4347f5c583264cfc8fedeec14a77e7d7. Latest consensus state: current_term: 1 leader_uuid: "4347f5c583264cfc8fedeec14a77e7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } } }
I20260808 07:08:05.138547 17808 sys_catalog.cc:455] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4347f5c583264cfc8fedeec14a77e7d7. Latest consensus state: current_term: 1 leader_uuid: "4347f5c583264cfc8fedeec14a77e7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } } }
I20260808 07:08:05.138610 17785 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:08:05.138626 17808 sys_catalog.cc:458] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:08:05.139631 17824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4347f5c583264cfc8fedeec14a77e7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } } }
I20260808 07:08:05.139712 17824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:05.140233 17785 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4347f5c583264cfc8fedeec14a77e7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } } }
I20260808 07:08:05.140322 17785 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:08:05.140476 17831 mvcc.cc:205] Tried to move back new op lower bound from 7316164137517162496 to 7316164137508839424. Current Snapshot: MvccSnapshot[applied={T|T < 7316164137517162496}]
I20260808 07:08:05.140571 17829 mvcc.cc:205] Tried to move back new op lower bound from 7316164137517162496 to 7316164137508839424. Current Snapshot: MvccSnapshot[applied={T|T < 7316164137517162496}]
I20260808 07:08:05.145586 17828 catalog_manager.cc:1347] Generated new cluster ID: ee12b9fe73794b5880421d6073cf419f
I20260808 07:08:05.145701 17828 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:08:05.150275 17760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4347f5c583264cfc8fedeec14a77e7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } } }
I20260808 07:08:05.150375 17760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7 [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:05.150967 17808 sys_catalog.cc:455] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4347f5c583264cfc8fedeec14a77e7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4347f5c583264cfc8fedeec14a77e7d7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42135 } } peers { permanent_uuid: "e127a8374fbf4930a583f6d59ced1bbc" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 33097 } } peers { permanent_uuid: "fdc0f144fb5f45538beba88b754f7e2a" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 32975 } } }
I20260808 07:08:05.151052 17808 sys_catalog.cc:458] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:08:05.151361 17835 mvcc.cc:205] Tried to move back new op lower bound from 7316164137517162496 to 7316164137508839424. Current Snapshot: MvccSnapshot[applied={T|T < 7316164137517162496}]
I20260808 07:08:05.168699 17828 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:08:05.169584 17828 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:08:05.182934 17828 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4347f5c583264cfc8fedeec14a77e7d7: Generated new TSK 0
I20260808 07:08:05.183254 17828 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:08:06.084517 17805 catalog_manager.cc:1259] Loaded cluster ID: ee12b9fe73794b5880421d6073cf419f
I20260808 07:08:06.084600 17805 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a: loading cluster ID for follower catalog manager: success
I20260808 07:08:06.085412 17805 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a: acquiring CA information for follower catalog manager: success
I20260808 07:08:06.085696 17805 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fdc0f144fb5f45538beba88b754f7e2a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:08:06.128739 17822 catalog_manager.cc:1259] Loaded cluster ID: ee12b9fe73794b5880421d6073cf419f
I20260808 07:08:06.128821 17822 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc: loading cluster ID for follower catalog manager: success
I20260808 07:08:06.129678 17822 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc: acquiring CA information for follower catalog manager: success
I20260808 07:08:06.130000 17822 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e127a8374fbf4930a583f6d59ced1bbc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:08:06.238500 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 17431
I20260808 07:08:06.248221 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 17540
I20260808 07:08:06.258423 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 17648
2026-08-08T07:08:06Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2919 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:08:06 dist-test-slave-rmhg krb5kdc[17858](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:08:06 dist-test-slave-rmhg krb5kdc[17858](info): set up 2 sockets
Aug 08 07:08:06 dist-test-slave-rmhg krb5kdc[17858](info): commencing operation
krb5kdc: starting...
W20260808 07:08:07.392237 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:08:07 dist-test-slave-rmhg krb5kdc[17858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:08:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:08:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:08:07.519863 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:44485
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:44485
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:07.604121 17872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:07.604357 17872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:07.604380 17872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:07.605602 17872 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:08:07.605643 17872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:07.605654 17872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:07.605665 17872 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:08:07.605676 17872 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:08:07.607200 17872 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:44485
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:44485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:07.607429 17872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:07.607613 17872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:07.612617 17886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:07.612686 17880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:07.612727 17872 server_base.cc:1034] running on GCE node
W20260808 07:08:07.612593 17882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:07.613248 17872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:07.613555 17872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:07.614717 17872 hybrid_clock.cc:648] HybridClock initialized: now 1786172887614709 us; error 40 us; skew 500 ppm
Aug 08 07:08:07 dist-test-slave-rmhg krb5kdc[17858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172887, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:07.621518 17872 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:08:07.622072 17872 webserver.cc:460] Webserver started at http://127.29.82.126:43973/ using document root <none> and password file <none>
I20260808 07:08:07.622292 17872 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:07.622345 17872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:07.622483 17872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:08:07.623620 17872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "1bec6a47d81f48a2808e73bae21c2ff8"
format_stamp: "Formatted at 2026-08-08 07:08:07 on dist-test-slave-rmhg"
server_key: "73ff013732e771cd37e029cdeeda4de1"
server_key_iv: "b36bf4f653ef7af22d4a5ef81a87872a"
server_key_version: "encryptionkey@0"
I20260808 07:08:07.623983 17872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "1bec6a47d81f48a2808e73bae21c2ff8"
format_stamp: "Formatted at 2026-08-08 07:08:07 on dist-test-slave-rmhg"
server_key: "73ff013732e771cd37e029cdeeda4de1"
server_key_iv: "b36bf4f653ef7af22d4a5ef81a87872a"
server_key_version: "encryptionkey@0"
I20260808 07:08:07.625485 17872 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:08:07.626276 17897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:07.626432 17872 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:08:07.626581 17872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "1bec6a47d81f48a2808e73bae21c2ff8"
format_stamp: "Formatted at 2026-08-08 07:08:07 on dist-test-slave-rmhg"
server_key: "73ff013732e771cd37e029cdeeda4de1"
server_key_iv: "b36bf4f653ef7af22d4a5ef81a87872a"
server_key_version: "encryptionkey@0"
I20260808 07:08:07.626652 17872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:07.663183 17872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:07.665441 17872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:07.665592 17872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:07.669454 17872 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:44485
I20260808 07:08:07.669502 17970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:44485 every 8 connection(s)
I20260808 07:08:07.669842 17872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:08:07.670765 17971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:07.673108 17971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8: Bootstrap starting.
I20260808 07:08:07.673758 17971 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:07.674031 17971 log.cc:824] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:07.674744 17971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8: No bootstrap required, opened a new log
I20260808 07:08:07.676110 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 17872
I20260808 07:08:07.676199 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:08:07.676378 30025 external_mini_cluster.cc:1428] Setting key 59d52b1d18cd5be71dca03e7c4f067cb
I20260808 07:08:07.676394 17971 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bec6a47d81f48a2808e73bae21c2ff8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44485 } }
I20260808 07:08:07.676590 17971 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:07.676636 17971 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bec6a47d81f48a2808e73bae21c2ff8, State: Initialized, Role: FOLLOWER
I20260808 07:08:07.676792 17971 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bec6a47d81f48a2808e73bae21c2ff8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44485 } }
I20260808 07:08:07.676936 17971 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:08:07.676999 17971 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:08:07.677084 17971 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:07.678009 17971 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bec6a47d81f48a2808e73bae21c2ff8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44485 } }
I20260808 07:08:07.678104 17971 leader_election.cc:302] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1bec6a47d81f48a2808e73bae21c2ff8; no voters:
I20260808 07:08:07.678270 17971 leader_election.cc:288] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:08:07.678319 17976 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:08:07.678476 17976 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [term 1 LEADER]: Becoming Leader. State: Replica: 1bec6a47d81f48a2808e73bae21c2ff8, State: Running, Role: LEADER
I20260808 07:08:07.678552 17971 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:08:07.678576 17976 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bec6a47d81f48a2808e73bae21c2ff8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44485 } }
I20260808 07:08:07.679014 17978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1bec6a47d81f48a2808e73bae21c2ff8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bec6a47d81f48a2808e73bae21c2ff8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44485 } } }
I20260808 07:08:07.679040 17981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bec6a47d81f48a2808e73bae21c2ff8. Latest consensus state: current_term: 1 leader_uuid: "1bec6a47d81f48a2808e73bae21c2ff8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bec6a47d81f48a2808e73bae21c2ff8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44485 } } }
I20260808 07:08:07.679210 17981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:07.679418 17992 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:08:07.679136 17978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8 [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:07.679993 17992 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:08:07.681730 17992 catalog_manager.cc:1347] Generated new cluster ID: b929286ceb6b4b2f97df2ad1d1bbb8dd
I20260808 07:08:07.681783 17992 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:08:07 dist-test-slave-rmhg krb5kdc[17858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:07.686966 17975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:07.676871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52906 (local address 127.29.82.126:44485)
0808 07:08:07.677075 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:07.677085 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:07.677117 (+ 32us) server_negotiation.cc:407] Connection header received
0808 07:08:07.677266 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:07.677272 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:07.677326 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:07.677447 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:07.678095 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:07.679398 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:07.680453 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:07.680975 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:07.681084 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:07.683486 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:07.683490 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:07.683491 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:07.683504 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:07.685123 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:07.685471 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:07.685475 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:07.685476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:07.685578 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:07.685756 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:07.685757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:07.685758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:07.685999 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:07.686648 (+ 649us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:07.686709 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 07:08:07.686819 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":91,"threads_started":1}
I20260808 07:08:07.687875 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:08:07.697006 17992 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:08:07.697620 17992 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:08:07.702926 17992 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1bec6a47d81f48a2808e73bae21c2ff8: Generated new TSK 0
I20260808 07:08:07.703125 17992 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:08:07.741825 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 17872
2026-08-08T07:08:07Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1483 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:08:07 dist-test-slave-rmhg krb5kdc[18012](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:08:07 dist-test-slave-rmhg krb5kdc[18012](info): set up 2 sockets
Aug 08 07:08:07 dist-test-slave-rmhg krb5kdc[18012](info): commencing operation
krb5kdc: starting...
W20260808 07:08:08.876281 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:08:08 dist-test-slave-rmhg krb5kdc[18012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:08:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:08:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:08:08.998342 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:46815
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:46815
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:09.083201 18033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:09.083441 18033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:09.083475 18033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:09.084726 18033 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:08:09.084777 18033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:09.084796 18033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:09.084813 18033 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:08:09.084828 18033 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:08:09.086426 18033 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:46815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:46815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:09.086705 18033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:09.086932 18033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:09.091868 18042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:09.091868 18045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:09.091893 18043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:09.092197 18033 server_base.cc:1034] running on GCE node
I20260808 07:08:09.092434 18033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:09.092727 18033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:09.093873 18033 hybrid_clock.cc:648] HybridClock initialized: now 1786172889093852 us; error 38 us; skew 500 ppm
Aug 08 07:08:09 dist-test-slave-rmhg krb5kdc[18012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172889, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:09.096328 18033 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:08:09.096803 18033 webserver.cc:460] Webserver started at http://127.29.82.126:38009/ using document root <none> and password file <none>
I20260808 07:08:09.097015 18033 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:09.097065 18033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:09.097240 18033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:08:09.098325 18033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "ec4e2949f1b6449db6fc25599b93c27c"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "c8e82f6d39f6ad05c14ad2d224bf7062"
server_key_iv: "bda570bc009c141a785c52f23f16a8b5"
server_key_version: "encryptionkey@0"
I20260808 07:08:09.098680 18033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "ec4e2949f1b6449db6fc25599b93c27c"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "c8e82f6d39f6ad05c14ad2d224bf7062"
server_key_iv: "bda570bc009c141a785c52f23f16a8b5"
server_key_version: "encryptionkey@0"
I20260808 07:08:09.100090 18033 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:08:09.100900 18054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:09.101244 18033 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:08:09.101366 18033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "ec4e2949f1b6449db6fc25599b93c27c"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "c8e82f6d39f6ad05c14ad2d224bf7062"
server_key_iv: "bda570bc009c141a785c52f23f16a8b5"
server_key_version: "encryptionkey@0"
I20260808 07:08:09.101442 18033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:09.116380 18033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:09.118739 18033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:09.118908 18033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:09.123011 18033 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:46815
I20260808 07:08:09.123044 18129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:46815 every 8 connection(s)
I20260808 07:08:09.123400 18033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:08:09.124260 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 18033
I20260808 07:08:09.124369 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:08:09.124550 18130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:09.124615 30025 external_mini_cluster.cc:1428] Setting key e2c2054713dc872feb60f8f80e955a48
I20260808 07:08:09.127840 18130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Bootstrap starting.
I20260808 07:08:09.128470 18130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:09.128728 18130 log.cc:824] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:09.129422 18130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: No bootstrap required, opened a new log
Aug 08 07:08:09 dist-test-slave-rmhg krb5kdc[18012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:09.131237 18130 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } }
I20260808 07:08:09.131373 18130 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:09.131407 18130 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4e2949f1b6449db6fc25599b93c27c, State: Initialized, Role: FOLLOWER
I20260808 07:08:09.131549 18130 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } }
I20260808 07:08:09.131633 18130 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:08:09.131656 18130 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:08:09.131704 18130 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:09.132229 18130 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } }
I20260808 07:08:09.132328 18130 leader_election.cc:302] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec4e2949f1b6449db6fc25599b93c27c; no voters:
I20260808 07:08:09.132498 18130 leader_election.cc:288] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:08:09.132539 18136 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:08:09.132645 18136 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 1 LEADER]: Becoming Leader. State: Replica: ec4e2949f1b6449db6fc25599b93c27c, State: Running, Role: LEADER
I20260808 07:08:09.132778 18130 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:08:09.132787 18136 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } }
I20260808 07:08:09.133209 18136 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec4e2949f1b6449db6fc25599b93c27c. Latest consensus state: current_term: 1 leader_uuid: "ec4e2949f1b6449db6fc25599b93c27c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } } }
I20260808 07:08:09.133366 18136 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:09.133221 18137 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec4e2949f1b6449db6fc25599b93c27c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } } }
I20260808 07:08:09.133641 18137 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:09.134579 18151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:08:09.135099 18134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.125240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53202 (local address 127.29.82.126:46815)
0808 07:08:09.125424 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:09.125432 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:09.125458 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:08:09.126018 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:09.126025 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:09.126077 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:09.126192 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:09.126985 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.127893 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.128679 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.129184 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.129284 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.131468 (+ 2184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:09.131473 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:09.131473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:09.131489 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:09.133250 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:09.133614 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:09.133617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:09.133618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:09.133728 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:09.133957 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:09.133958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:09.133958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:09.134331 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:09.134468 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:09.134714 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 07:08:09.134950 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":65,"threads_started":1}
I20260808 07:08:09.135281 18151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:08:09.136721 18151 catalog_manager.cc:1347] Generated new cluster ID: c5c30edea4cf4e0289f22ac5b4299707
I20260808 07:08:09.136775 18151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:08:09.154623 18151 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:08:09.155164 18151 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:08:09.159289 18151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Generated new TSK 0
I20260808 07:08:09.159471 18151 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:08:09.192709 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46815
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:09.276997 18165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:09.277271 18165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:09.277302 18165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:09.278529 18165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:09.278573 18165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:09.278600 18165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:08:09.280105 18165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:09.280336 18165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:09.280589 18165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:09.286072 18174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:09.286094 18171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:09.286094 18172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:09.287002 18165 server_base.cc:1034] running on GCE node
I20260808 07:08:09.287215 18165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:09.287439 18165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:09.288614 18165 hybrid_clock.cc:648] HybridClock initialized: now 1786172889288599 us; error 30 us; skew 500 ppm
Aug 08 07:08:09 dist-test-slave-rmhg krb5kdc[18012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172889, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:09.291165 18165 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:08:09.291675 18165 webserver.cc:460] Webserver started at http://127.29.82.65:36639/ using document root <none> and password file <none>
I20260808 07:08:09.291880 18165 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:09.291929 18165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:09.292058 18165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:08:09.293111 18165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "ebab049d53db472e8671ff1d31518f9f"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "9ac54660e6dcd36fb3ad44ded5538315"
server_key_iv: "4a2102df71d13de04f8c2152707a2c83"
server_key_version: "encryptionkey@0"
I20260808 07:08:09.293501 18165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "ebab049d53db472e8671ff1d31518f9f"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "9ac54660e6dcd36fb3ad44ded5538315"
server_key_iv: "4a2102df71d13de04f8c2152707a2c83"
server_key_version: "encryptionkey@0"
I20260808 07:08:09.294785 18165 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:09.295423 18185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:09.295611 18165 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:08:09.295698 18165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "ebab049d53db472e8671ff1d31518f9f"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "9ac54660e6dcd36fb3ad44ded5538315"
server_key_iv: "4a2102df71d13de04f8c2152707a2c83"
server_key_version: "encryptionkey@0"
I20260808 07:08:09.295765 18165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:09.306370 18165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:09.308583 18165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:09.308741 18165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:09.308969 18165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:09.309329 18165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:09.309365 18165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:09.309396 18165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:09.309420 18165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:09.315248 18165 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:33171
I20260808 07:08:09.315299 18338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:33171 every 8 connection(s)
I20260808 07:08:09.315636 18165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:08:09.318876 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 18165
I20260808 07:08:09.318986 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:08:09.319190 30025 external_mini_cluster.cc:1428] Setting key b0ef6c4accf6f94599876ef4ff79a93f
Aug 08 07:08:09 dist-test-slave-rmhg krb5kdc[18012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172889, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:09.326013 18134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.316388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:43721 (local address 127.29.82.126:46815)
0808 07:08:09.316450 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:09.316452 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:09.316668 (+ 216us) server_negotiation.cc:407] Connection header received
0808 07:08:09.317713 (+ 1045us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:09.317714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:09.317729 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:09.317780 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:09.318442 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.319108 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.320201 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.320470 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.320546 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.322888 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:09.322889 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:09.322890 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:09.322898 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:09.324473 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:09.324939 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:09.324940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:09.324941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:09.325009 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:09.325292 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:09.325293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:09.325293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:09.325450 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:09.325528 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:09.325803 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 07:08:09.325909 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 07:08:09.326087 18341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.316357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:43721)
0808 07:08:09.316533 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:09.316576 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:09.317601 (+ 1025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:09.317854 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:09.317858 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:09.318144 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:09.318347 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.318351 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.319211 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.319212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.320118 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.320120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.320549 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.320549 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.320653 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.321205 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:09.321215 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:09.322806 (+ 1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:09.324572 (+ 1766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:09.324580 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:09.324582 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:09.324863 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:09.325077 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:09.325077 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:09.325078 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:09.325236 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:09.325519 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:09.325525 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:09.325665 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 07:08:09.325750 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 07:08:09.325898 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
I20260808 07:08:09.326908 18339 heartbeater.cc:347] Connected to a master server at 127.29.82.126:46815
I20260808 07:08:09.327035 18339 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:09.327260 18339 heartbeater.cc:511] Master 127.29.82.126:46815 requested a full tablet report, sending...
I20260808 07:08:09.327884 18079 ts_manager.cc:194] Registered new tserver with Master: ebab049d53db472e8671ff1d31518f9f (127.29.82.65:33171)
I20260808 07:08:09.328549 18079 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:43721
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:08:09.347755 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46815
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:09.430428 18347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:09.430656 18347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:09.430680 18347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:09.431864 18347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:09.431911 18347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:09.431941 18347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:08:09.433561 18347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:09.433790 18347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:09.434005 18347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:09.438865 18355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:09.438836 18358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:09.438851 18354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:09.439193 18347 server_base.cc:1034] running on GCE node
I20260808 07:08:09.439395 18347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:09.439639 18347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:09.440786 18347 hybrid_clock.cc:648] HybridClock initialized: now 1786172889440772 us; error 26 us; skew 500 ppm
Aug 08 07:08:09 dist-test-slave-rmhg krb5kdc[18012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172889, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:09.443240 18347 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:08:09.443708 18347 webserver.cc:460] Webserver started at http://127.29.82.66:38431/ using document root <none> and password file <none>
I20260808 07:08:09.443943 18347 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:09.443992 18347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:09.444121 18347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:08:09.445241 18347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "1d06d421941b4b969a01b02eaf1f7d91"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "877f4909ac0cef268864dba77bb125e5"
server_key_iv: "956504a6862121880f740be94df78ef3"
server_key_version: "encryptionkey@0"
I20260808 07:08:09.445585 18347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "1d06d421941b4b969a01b02eaf1f7d91"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "877f4909ac0cef268864dba77bb125e5"
server_key_iv: "956504a6862121880f740be94df78ef3"
server_key_version: "encryptionkey@0"
I20260808 07:08:09.446841 18347 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:09.447539 18366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:09.447674 18347 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:08:09.447762 18347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "1d06d421941b4b969a01b02eaf1f7d91"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "877f4909ac0cef268864dba77bb125e5"
server_key_iv: "956504a6862121880f740be94df78ef3"
server_key_version: "encryptionkey@0"
I20260808 07:08:09.447820 18347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:09.467447 18347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:09.469408 18347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:09.469553 18347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:09.469796 18347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:09.470124 18347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:09.470160 18347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:09.470191 18347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:09.470207 18347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:09.475782 18347 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:45409
I20260808 07:08:09.475829 18549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:45409 every 8 connection(s)
I20260808 07:08:09.476157 18347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:08:09 dist-test-slave-rmhg krb5kdc[18012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172889, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:09.483696 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 18347
I20260808 07:08:09.483794 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:08:09.483973 30025 external_mini_cluster.cc:1428] Setting key ad5563238626c50ca24ef18d519b0fcf
I20260808 07:08:09.486166 18134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.476923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:47191 (local address 127.29.82.126:46815)
0808 07:08:09.476993 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:09.476995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:09.477213 (+ 218us) server_negotiation.cc:407] Connection header received
0808 07:08:09.477731 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:09.477732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:09.477746 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:09.477795 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:09.478768 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.479271 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.480286 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.480489 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.480546 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.483049 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:09.483051 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:09.483051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:09.483059 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:09.484533 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:09.485175 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:09.485177 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:09.485177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:09.485245 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:09.485538 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:09.485539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:09.485539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:09.485659 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:09.485714 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:09.486026 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 07:08:09.486097 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 07:08:09.486418 18554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.476894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:47191)
0808 07:08:09.477072 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:09.477109 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:09.477628 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:09.477879 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:09.477883 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:09.478457 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:09.478664 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.478669 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.479361 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.479362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.480193 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.480196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.480565 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.480566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.480688 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.481332 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:09.481342 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:09.482942 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:09.484714 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:09.484722 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:09.484725 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:09.485059 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:09.485312 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:09.485313 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:09.485314 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:09.485462 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:09.485715 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:09.485720 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:09.485891 (+ 171us) client_negotiation.cc:769] Sending connection context
0808 07:08:09.486009 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 07:08:09.486183 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":107,"threads_started":1}
I20260808 07:08:09.486949 18550 heartbeater.cc:347] Connected to a master server at 127.29.82.126:46815
I20260808 07:08:09.487069 18550 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:09.487277 18550 heartbeater.cc:511] Master 127.29.82.126:46815 requested a full tablet report, sending...
I20260808 07:08:09.487712 18079 ts_manager.cc:194] Registered new tserver with Master: 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66:45409)
I20260808 07:08:09.488093 18079 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:47191
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:08:09.510864 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46815
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:09.594444 18559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:09.594676 18559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:09.594707 18559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:09.595924 18559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:09.595973 18559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:09.596017 18559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:08:09.597559 18559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:46815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:09.597810 18559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:09.598039 18559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:09.603199 18570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:09.603207 18569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:09.603343 18559 server_base.cc:1034] running on GCE node
W20260808 07:08:09.603478 18575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:09.603705 18559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:09.603972 18559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:09.605113 18559 hybrid_clock.cc:648] HybridClock initialized: now 1786172889605099 us; error 25 us; skew 500 ppm
Aug 08 07:08:09 dist-test-slave-rmhg krb5kdc[18012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172889, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:09.607775 18559 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:08:09.608196 18559 webserver.cc:460] Webserver started at http://127.29.82.67:36739/ using document root <none> and password file <none>
I20260808 07:08:09.608393 18559 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:09.608443 18559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:09.608577 18559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:08:09.609655 18559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "01b87acf79224b128a1bf9e9a32f390a"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "830f9d9b99a8f248ad4c05bace92c899"
server_key_iv: "4343b2b7578c0d965087ff4b250f5597"
server_key_version: "encryptionkey@0"
I20260808 07:08:09.609993 18559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "01b87acf79224b128a1bf9e9a32f390a"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "830f9d9b99a8f248ad4c05bace92c899"
server_key_iv: "4343b2b7578c0d965087ff4b250f5597"
server_key_version: "encryptionkey@0"
I20260808 07:08:09.611248 18559 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:08:09.611972 18584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:09.612130 18559 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:08:09.612228 18559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "01b87acf79224b128a1bf9e9a32f390a"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "830f9d9b99a8f248ad4c05bace92c899"
server_key_iv: "4343b2b7578c0d965087ff4b250f5597"
server_key_version: "encryptionkey@0"
I20260808 07:08:09.612290 18559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:09.627681 18559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:09.630009 18559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:09.630156 18559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:09.630389 18559 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:09.630716 18559 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:09.630753 18559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:09.630784 18559 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:09.630800 18559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:09.636740 18559 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:36125
I20260808 07:08:09.636803 18751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:36125 every 8 connection(s)
I20260808 07:08:09.637106 18559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:08:09 dist-test-slave-rmhg krb5kdc[18012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172889, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:09.645732 18134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.637815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:55685 (local address 127.29.82.126:46815)
0808 07:08:09.637874 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:09.637876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:09.638095 (+ 219us) server_negotiation.cc:407] Connection header received
0808 07:08:09.638595 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:09.638596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:09.638605 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:09.638661 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:09.639584 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.640079 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.641031 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.641261 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.641312 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.643344 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:09.643346 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:09.643346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:09.643354 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:09.644600 (+ 1246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:09.644951 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:09.644951 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:09.644952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:09.644999 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:09.645206 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:09.645206 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:09.645207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:09.645311 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:09.645360 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:09.645598 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 07:08:09.645661 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:08:09.645874 18758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.637801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:55685)
0808 07:08:09.637972 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:09.638015 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:09.638496 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:09.638719 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:09.638723 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:09.639295 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:09.639504 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.639509 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.640150 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.640151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.640966 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.640969 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.641331 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.641332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.641451 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.641878 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:09.641886 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:09.643265 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:09.644677 (+ 1412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:09.644683 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:09.644685 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:09.644896 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:09.645041 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:09.645042 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:09.645042 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:09.645130 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:09.645356 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:09.645360 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:09.645483 (+ 123us) client_negotiation.cc:769] Sending connection context
0808 07:08:09.645563 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 07:08:09.645687 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":76,"threads_started":1}
I20260808 07:08:09.646358 18752 heartbeater.cc:347] Connected to a master server at 127.29.82.126:46815
I20260808 07:08:09.646452 18752 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:09.646631 18752 heartbeater.cc:511] Master 127.29.82.126:46815 requested a full tablet report, sending...
I20260808 07:08:09.646864 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 18559
I20260808 07:08:09.646952 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:08:09.647037 18079 ts_manager.cc:194] Registered new tserver with Master: 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125)
I20260808 07:08:09.647123 30025 external_mini_cluster.cc:1428] Setting key a925b7b1b382d86287662f90e4b8e2b3
I20260808 07:08:09.647528 18079 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:55685
I20260808 07:08:09.647958 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:08:09.654769 18134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.649218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54698 (local address 127.29.82.126:46815)
0808 07:08:09.649256 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:09.649258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:09.649384 (+ 126us) server_negotiation.cc:407] Connection header received
0808 07:08:09.649441 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:09.649443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:09.649452 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:09.649496 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:09.650019 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.650493 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.651230 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.651429 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.651482 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.652570 (+ 1088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:09.652571 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:09.652572 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:09.652579 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:09.653723 (+ 1144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:09.654033 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:09.654034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:09.654034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:09.654091 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:09.654248 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:09.654248 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:09.654249 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:09.654392 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:09.654479 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:09.654605 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 07:08:09.654678 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:08:09.656128 18079 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54698:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:08:09.657784 18079 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:08:09.663906 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.659883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:36125 (local address 127.0.0.1:42600)
0808 07:08:09.659992 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:09.660030 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:09.660097 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:09.660396 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:09.660400 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:09.660403 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:09.660479 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.660499 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.661590 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.661590 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.662754 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.662757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.663611 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.663612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.663691 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.663704 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 07:08:09.663770 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 07:08:09.663826 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":75,"threads_started":1}
I20260808 07:08:09.663986 18768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.659878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:45409 (local address 127.0.0.1:60724)
0808 07:08:09.659991 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:09.660030 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:09.660097 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:09.660621 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:09.660621 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:09.660623 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:09.660686 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.660687 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.662003 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.662004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.662994 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.662996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.663734 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.663735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.663804 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.663808 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:08:09.663855 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:08:09.663887 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":62,"threads_started":1}
I20260808 07:08:09.663995 18777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.660221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60724 (local address 127.29.82.66:45409)
0808 07:08:09.660383 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:09.660388 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:09.660398 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:08:09.660438 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:09.660440 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:09.660455 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:09.660532 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:09.660764 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.661887 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.663067 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.663665 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.663735 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.663786 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:09.663868 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 07:08:09.663906 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":78,"threads_started":1}
I20260808 07:08:09.664255 18776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.660063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42600 (local address 127.29.82.67:36125)
0808 07:08:09.660257 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:09.660261 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:09.660268 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:08:09.660297 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:09.660299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:09.660311 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:09.660378 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:09.660579 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.661506 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.662843 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.663531 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.663595 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.663659 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:09.664129 (+ 470us) server_negotiation.cc:299] Negotiation successful
0808 07:08:09.664174 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":96,"threads_started":1}
I20260808 07:08:09.664906 18773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.660086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:33171 (local address 127.0.0.1:47544)
0808 07:08:09.660661 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:09.660670 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:09.660713 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:09.660976 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:09.660977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:09.660980 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:09.661028 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.661029 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.662228 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.662229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.663264 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.663267 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.664679 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.664680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.664740 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.664744 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:08:09.664802 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:08:09.664837 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":46,"threads_started":1}
I20260808 07:08:09.664937 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.660485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47544 (local address 127.29.82.65:33171)
0808 07:08:09.660820 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:09.660824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:09.660833 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:08:09.660868 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:09.660870 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:09.660884 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:09.660959 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:09.661094 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.662142 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.663346 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.664599 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.664668 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.664720 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:09.664819 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 07:08:09.664863 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":95,"threads_started":1}
I20260808 07:08:09.664955 18662 tablet_service.cc:1467] Processing CreateTablet for tablet 6bb78b282ddb40abb3733dc97235bcc0 (DEFAULT_TABLE table=test-table [id=6dccaf009693419b887798416114ea04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:09.664944 18449 tablet_service.cc:1467] Processing CreateTablet for tablet 6bb78b282ddb40abb3733dc97235bcc0 (DEFAULT_TABLE table=test-table [id=6dccaf009693419b887798416114ea04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:09.665328 18449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bb78b282ddb40abb3733dc97235bcc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:09.665333 18662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bb78b282ddb40abb3733dc97235bcc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:09.665576 18252 tablet_service.cc:1467] Processing CreateTablet for tablet 6bb78b282ddb40abb3733dc97235bcc0 (DEFAULT_TABLE table=test-table [id=6dccaf009693419b887798416114ea04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:09.665872 18252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bb78b282ddb40abb3733dc97235bcc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:09.667992 18780 tablet_bootstrap.cc:492] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91: Bootstrap starting.
I20260808 07:08:09.668591 18780 tablet_bootstrap.cc:654] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:09.669040 18781 tablet_bootstrap.cc:492] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: Bootstrap starting.
I20260808 07:08:09.669041 18780 log.cc:824] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:09.669306 18782 tablet_bootstrap.cc:492] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a: Bootstrap starting.
I20260808 07:08:09.669631 18781 tablet_bootstrap.cc:654] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:09.669905 18782 tablet_bootstrap.cc:654] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:09.669901 18780 tablet_bootstrap.cc:492] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91: No bootstrap required, opened a new log
I20260808 07:08:09.669970 18780 ts_tablet_manager.cc:1397] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:08:09.670177 18781 log.cc:824] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:09.670421 18782 log.cc:824] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:09.670853 18781 tablet_bootstrap.cc:492] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: No bootstrap required, opened a new log
I20260808 07:08:09.670909 18781 ts_tablet_manager.cc:1397] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:08:09.671542 18780 raft_consensus.cc:348] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } } peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } }
I20260808 07:08:09.671672 18780 raft_consensus.cc:374] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:09.671702 18780 raft_consensus.cc:729] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d06d421941b4b969a01b02eaf1f7d91, State: Initialized, Role: FOLLOWER
I20260808 07:08:09.671826 18780 consensus_queue.cc:260] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } } peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } }
I20260808 07:08:09.672098 18780 ts_tablet_manager.cc:1428] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:08:09.672129 18550 heartbeater.cc:503] Master 127.29.82.126:46815 was elected leader, sending a full tablet report...
I20260808 07:08:09.672372 18781 raft_consensus.cc:348] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } } peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } }
I20260808 07:08:09.672519 18781 raft_consensus.cc:374] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:09.672577 18781 raft_consensus.cc:729] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebab049d53db472e8671ff1d31518f9f, State: Initialized, Role: FOLLOWER
I20260808 07:08:09.672693 18781 consensus_queue.cc:260] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } } peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } }
I20260808 07:08:09.672747 18782 tablet_bootstrap.cc:492] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a: No bootstrap required, opened a new log
I20260808 07:08:09.672804 18782 ts_tablet_manager.cc:1397] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 07:08:09.672962 18781 ts_tablet_manager.cc:1428] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:08:09.672983 18339 heartbeater.cc:503] Master 127.29.82.126:46815 was elected leader, sending a full tablet report...
I20260808 07:08:09.674541 18782 raft_consensus.cc:348] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } } peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } }
I20260808 07:08:09.674660 18782 raft_consensus.cc:374] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:09.674690 18782 raft_consensus.cc:729] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b87acf79224b128a1bf9e9a32f390a, State: Initialized, Role: FOLLOWER
I20260808 07:08:09.674794 18782 consensus_queue.cc:260] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } } peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } }
I20260808 07:08:09.675045 18782 ts_tablet_manager.cc:1428] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:08:09.675066 18752 heartbeater.cc:503] Master 127.29.82.126:46815 was elected leader, sending a full tablet report...
W20260808 07:08:09.726828 18551 tablet.cc:2369] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:08:09.760329 18792 raft_consensus.cc:482] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:08:09.760468 18792 raft_consensus.cc:504] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } } peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } }
I20260808 07:08:09.760907 18792 leader_election.cc:288] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125), 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66:45409)
I20260808 07:08:09.763767 18776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.761223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:54443 (local address 127.29.82.67:36125)
0808 07:08:09.761267 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:09.761268 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:09.761276 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:08:09.761304 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:09.761304 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:09.761315 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:09.761372 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:09.761580 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.762079 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.763055 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.763425 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.763488 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.763498 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:09.763654 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 07:08:09.763693 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:08:09.763773 18777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.761248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:35403 (local address 127.29.82.66:45409)
0808 07:08:09.761295 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:09.761297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:09.761394 (+ 97us) server_negotiation.cc:407] Connection header received
0808 07:08:09.761440 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:09.761441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:09.761452 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:09.761506 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:09.761654 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.762121 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.763054 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.763425 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.763488 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.763498 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:09.763667 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 07:08:09.763704 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:08:09.763783 18341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.761097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:36125 (local address 127.29.82.65:54443)
0808 07:08:09.761143 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:09.761175 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:09.761223 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:09.761394 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:09.761395 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:09.761398 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:09.761482 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.761485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.762153 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.762154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.762954 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.762956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.763511 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.763512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.763585 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.763588 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:08:09.763630 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 07:08:09.763673 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23,"mutex_wait_us":33}
I20260808 07:08:09.763794 18798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.761129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:45409 (local address 127.29.82.65:35403)
0808 07:08:09.761326 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:09.761334 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:09.761384 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:09.761514 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:09.761515 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:09.761516 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:09.761591 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.761593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.762204 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.762205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.762957 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:09.762959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.763509 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.763510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:09.763597 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.763600 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:08:09.763651 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 07:08:09.763691 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":1,"thread_start_us":149,"threads_started":1}
I20260808 07:08:09.764184 18692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bb78b282ddb40abb3733dc97235bcc0" candidate_uuid: "ebab049d53db472e8671ff1d31518f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b87acf79224b128a1bf9e9a32f390a" is_pre_election: true
I20260808 07:08:09.764204 18483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bb78b282ddb40abb3733dc97235bcc0" candidate_uuid: "ebab049d53db472e8671ff1d31518f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d06d421941b4b969a01b02eaf1f7d91" is_pre_election: true
I20260808 07:08:09.764355 18483 raft_consensus.cc:2454] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebab049d53db472e8671ff1d31518f9f in term 0.
I20260808 07:08:09.764390 18692 raft_consensus.cc:2454] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebab049d53db472e8671ff1d31518f9f in term 0.
I20260808 07:08:09.764631 18194 leader_election.cc:302] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d06d421941b4b969a01b02eaf1f7d91, ebab049d53db472e8671ff1d31518f9f; no voters:
I20260808 07:08:09.764767 18792 raft_consensus.cc:2781] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:08:09.764839 18792 raft_consensus.cc:482] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:08:09.764856 18792 raft_consensus.cc:3037] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:09.765623 18792 raft_consensus.cc:504] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } } peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } }
I20260808 07:08:09.765743 18792 leader_election.cc:288] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 1 election: Requested vote from peers 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125), 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66:45409)
I20260808 07:08:09.765944 18692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bb78b282ddb40abb3733dc97235bcc0" candidate_uuid: "ebab049d53db472e8671ff1d31518f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b87acf79224b128a1bf9e9a32f390a"
I20260808 07:08:09.765975 18483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bb78b282ddb40abb3733dc97235bcc0" candidate_uuid: "ebab049d53db472e8671ff1d31518f9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d06d421941b4b969a01b02eaf1f7d91"
I20260808 07:08:09.766026 18692 raft_consensus.cc:3037] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:09.766048 18483 raft_consensus.cc:3037] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:09.766755 18483 raft_consensus.cc:2454] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebab049d53db472e8671ff1d31518f9f in term 1.
I20260808 07:08:09.766765 18692 raft_consensus.cc:2454] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebab049d53db472e8671ff1d31518f9f in term 1.
I20260808 07:08:09.766940 18188 leader_election.cc:302] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b87acf79224b128a1bf9e9a32f390a, ebab049d53db472e8671ff1d31518f9f; no voters:
I20260808 07:08:09.767042 18792 raft_consensus.cc:2781] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:08:09.767213 18792 raft_consensus.cc:686] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 1 LEADER]: Becoming Leader. State: Replica: ebab049d53db472e8671ff1d31518f9f, State: Running, Role: LEADER
I20260808 07:08:09.767302 18792 consensus_queue.cc:237] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } } peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } }
I20260808 07:08:09.768189 18078 catalog_manager.cc:5495] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f reported cstate change: term changed from 0 to 1, leader changed from <none> to ebab049d53db472e8671ff1d31518f9f (127.29.82.65). New cstate: current_term: 1 leader_uuid: "ebab049d53db472e8671ff1d31518f9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } health_report { overall_health: UNKNOWN } } }
I20260808 07:08:09.780725 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.778574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47548 (local address 127.29.82.65:33171)
0808 07:08:09.778624 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:09.778626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:09.778633 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:08:09.778666 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:09.778667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:09.778686 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:09.778743 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:08:09.778857 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.779320 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.780046 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:09.780244 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:09.780302 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:09.780428 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:08:09.780537 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:08:09.780597 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:09.780612 (+ 15us) server_negotiation.cc:299] Negotiation successful
0808 07:08:09.780630 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:08:09.782701 18483 raft_consensus.cc:1261] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91 [term 1 FOLLOWER]: Refusing update from remote peer ebab049d53db472e8671ff1d31518f9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:08:09.782699 18692 raft_consensus.cc:1261] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a [term 1 FOLLOWER]: Refusing update from remote peer ebab049d53db472e8671ff1d31518f9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:08:09.783084 18799 consensus_queue.cc:1035] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:08:09.783222 18792 consensus_queue.cc:1035] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:08:09.786437 18808 mvcc.cc:205] Tried to move back new op lower bound from 7316164156546924544 to 7316164156487577600. Current Snapshot: MvccSnapshot[applied={T|T < 7316164156546924544}]
I20260808 07:08:09.788172 18079 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:08:09.788264 18079 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:08:09.789005 18079 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Sending DeleteTablet for 3 replicas of tablet 6bb78b282ddb40abb3733dc97235bcc0
I20260808 07:08:09.789359 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 18165
I20260808 07:08:09.789388 18662 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bb78b282ddb40abb3733dc97235bcc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:09 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:42600
I20260808 07:08:09.789388 18252 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bb78b282ddb40abb3733dc97235bcc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:09 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:47544
I20260808 07:08:09.797978 18819 tablet_replica.cc:330] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a: stopping tablet replica
I20260808 07:08:09.798136 18819 raft_consensus.cc:2229] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:08:09.798275 18819 raft_consensus.cc:2258] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:09.798945 18819 ts_tablet_manager.cc:1905] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:08:09.800092 18449 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bb78b282ddb40abb3733dc97235bcc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:09 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:60724
I20260808 07:08:09.800956 18819 ts_tablet_manager.cc:1918] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:08:09.800976 18820 tablet_replica.cc:330] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91: stopping tablet replica
I20260808 07:08:09.801075 18819 log.cc:1196] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/6bb78b282ddb40abb3733dc97235bcc0
I20260808 07:08:09.801111 18820 raft_consensus.cc:2229] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:08:09.801286 18820 raft_consensus.cc:2258] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:09.801460 18819 ts_tablet_manager.cc:1939] T 6bb78b282ddb40abb3733dc97235bcc0 P 01b87acf79224b128a1bf9e9a32f390a: Deleting consensus metadata
I20260808 07:08:09.802026 18057 catalog_manager.cc:4841] TS 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125): tablet 6bb78b282ddb40abb3733dc97235bcc0 (table test-table [id=6dccaf009693419b887798416114ea04]) successfully deleted
I20260808 07:08:09.802371 18820 ts_tablet_manager.cc:1905] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:08:09.803663 18820 ts_tablet_manager.cc:1918] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:08:09.803754 18820 log.cc:1196] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/6bb78b282ddb40abb3733dc97235bcc0
I20260808 07:08:09.804029 18820 ts_tablet_manager.cc:1939] T 6bb78b282ddb40abb3733dc97235bcc0 P 1d06d421941b4b969a01b02eaf1f7d91: Deleting consensus metadata
I20260808 07:08:09.804507 18060 catalog_manager.cc:4841] TS 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66:45409): tablet 6bb78b282ddb40abb3733dc97235bcc0 (table test-table [id=6dccaf009693419b887798416114ea04]) successfully deleted
W20260808 07:08:09.806305 18057 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:33171 (error 108)
I20260808 07:08:09.806509 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 18347
I20260808 07:08:09.808666 18773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:09.808539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:33171 (local address 127.0.0.1:47556)
0808 07:08:09.808591 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:09.808634 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:33171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 07:08:09.808813 18057 catalog_manager.cc:4584] TS ebab049d53db472e8671ff1d31518f9f (127.29.82.65:33171): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6bb78b282ddb40abb3733dc97235bcc0: Network error: Client connection negotiation failed: client connection to 127.29.82.65:33171: connect: Connection refused (error 111)
I20260808 07:08:09.814666 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 18559
I20260808 07:08:09.828074 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 18033
I20260808 07:08:09.839067 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:46815
--webserver_interface=127.29.82.126
--webserver_port=38009
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:46815
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:09.923262 18822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:09.923517 18822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:09.923552 18822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:09.924772 18822 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:08:09.924817 18822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:09.924836 18822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:09.924852 18822 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:08:09.924868 18822 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:08:09.926468 18822 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:46815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:46815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=38009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:09.926739 18822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:09.926961 18822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:09.936549 18832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:09.936650 18822 server_base.cc:1034] running on GCE node
W20260808 07:08:09.936537 18835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:09.936537 18831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:09.937007 18822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:09.937371 18822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:09.938552 18822 hybrid_clock.cc:648] HybridClock initialized: now 1786172889938533 us; error 32 us; skew 500 ppm
Aug 08 07:08:09 dist-test-slave-rmhg krb5kdc[18012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172889, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:09.941231 18822 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:08:09.941675 18822 webserver.cc:460] Webserver started at http://127.29.82.126:38009/ using document root <none> and password file <none>
I20260808 07:08:09.941874 18822 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:09.941929 18822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:09.943307 18822 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:09.943912 18843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:09.944079 18822 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:08:09.944176 18822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "ec4e2949f1b6449db6fc25599b93c27c"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "c8e82f6d39f6ad05c14ad2d224bf7062"
server_key_iv: "bda570bc009c141a785c52f23f16a8b5"
server_key_version: "encryptionkey@0"
I20260808 07:08:09.944634 18822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:09.957742 18822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:09.959689 18822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:09.959810 18822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:09.963769 18822 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:46815
I20260808 07:08:09.963824 18915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:46815 every 8 connection(s)
I20260808 07:08:09.964188 18822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:08:09.964874 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 18822
I20260808 07:08:09.965170 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:33171
--local_ip_for_outbound_sockets=127.29.82.65
--tserver_master_addrs=127.29.82.126:46815
--webserver_port=36639
--webserver_interface=127.29.82.65
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:08:09.966177 18916 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:08:09.966990 18916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Bootstrap starting.
I20260808 07:08:09.975623 18916 log.cc:824] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:09.977820 18916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:08:09.978163 18916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Bootstrap complete.
I20260808 07:08:09.980448 18916 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } }
I20260808 07:08:09.980695 18916 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4e2949f1b6449db6fc25599b93c27c, State: Initialized, Role: FOLLOWER
I20260808 07:08:09.980845 18916 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } }
I20260808 07:08:09.980911 18916 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:08:09.980949 18916 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:08:09.980997 18916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:08:09.982064 18916 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } }
I20260808 07:08:09.982159 18916 leader_election.cc:302] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec4e2949f1b6449db6fc25599b93c27c; no voters:
I20260808 07:08:09.982328 18916 leader_election.cc:288] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 07:08:09.982380 18921 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:08:09.982503 18921 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 2 LEADER]: Becoming Leader. State: Replica: ec4e2949f1b6449db6fc25599b93c27c, State: Running, Role: LEADER
I20260808 07:08:09.982631 18916 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:08:09.982611 18921 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } }
I20260808 07:08:09.982971 18922 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ec4e2949f1b6449db6fc25599b93c27c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } } }
I20260808 07:08:09.982982 18927 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec4e2949f1b6449db6fc25599b93c27c. Latest consensus state: current_term: 2 leader_uuid: "ec4e2949f1b6449db6fc25599b93c27c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } } }
I20260808 07:08:09.983157 18922 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:09.983172 18927 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:09.983693 18935 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:08:09.984570 18935 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:08:09.984684 18935 catalog_manager.cc:1259] Loaded cluster ID: c5c30edea4cf4e0289f22ac5b4299707
I20260808 07:08:09.984724 18935 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:08:09.985059 18935 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 07:08:09.987753 18935 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 07:08:09.989662 18935 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:08:09.989880 18935 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Loaded TSK: 0
I20260808 07:08:09.990097 18935 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:08:10.063910 18918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:10.064195 18918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:10.064230 18918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:10.065654 18918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:10.065703 18918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:10.065728 18918 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:08:10.067265 18918 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:33171
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=36639
--tserver_master_addrs=127.29.82.126:46815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18918
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:10.067497 18918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:10.067727 18918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:10.072788 18960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:10.072851 18965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:10.072979 18918 server_base.cc:1034] running on GCE node
W20260808 07:08:10.073015 18963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:10.073315 18918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:10.073552 18918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:10.074693 18918 hybrid_clock.cc:648] HybridClock initialized: now 1786172890074681 us; error 33 us; skew 500 ppm
Aug 08 07:08:10 dist-test-slave-rmhg krb5kdc[18012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172890, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:10.077203 18918 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:08:10.077677 18918 webserver.cc:460] Webserver started at http://127.29.82.65:36639/ using document root <none> and password file <none>
I20260808 07:08:10.077900 18918 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:10.077965 18918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:10.079319 18918 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:08:10.079960 18975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:10.080142 18918 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:08:10.080263 18918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "ebab049d53db472e8671ff1d31518f9f"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "9ac54660e6dcd36fb3ad44ded5538315"
server_key_iv: "4a2102df71d13de04f8c2152707a2c83"
server_key_version: "encryptionkey@0"
I20260808 07:08:10.080732 18918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:10.102006 18918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:10.104617 18918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:10.104799 18918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:10.105111 18918 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:10.105698 18983 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 07:08:10.107240 18918 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 07:08:10.107307 18918 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 07:08:10.107342 18918 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 07:08:10.108230 18918 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 07:08:10.108278 18918 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 07:08:10.108356 18983 tablet_bootstrap.cc:492] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: Bootstrap starting.
I20260808 07:08:10.115615 18918 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:33171
I20260808 07:08:10.116145 18918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:08:10.118459 18983 log.cc:824] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:10.120121 19140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:33171 every 8 connection(s)
I20260808 07:08:10.121244 18983 tablet_bootstrap.cc:492] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:08:10.121541 18983 tablet_bootstrap.cc:492] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: Bootstrap complete.
I20260808 07:08:10.121994 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 18918
I20260808 07:08:10.122283 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:45409
--local_ip_for_outbound_sockets=127.29.82.66
--tserver_master_addrs=127.29.82.126:46815
--webserver_port=38431
--webserver_interface=127.29.82.66
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:08:10.122632 18983 ts_tablet_manager.cc:1397] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.013s
I20260808 07:08:10.124037 18983 raft_consensus.cc:348] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } } peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } }
I20260808 07:08:10.124356 18983 raft_consensus.cc:729] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebab049d53db472e8671ff1d31518f9f, State: Initialized, Role: FOLLOWER
I20260808 07:08:10.124521 18983 consensus_queue.cc:260] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } } peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } }
I20260808 07:08:10.124814 18983 ts_tablet_manager.cc:1428] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: Time spent starting tablet: real 0.002s user 0.000s sys 0.004s
Aug 08 07:08:10 dist-test-slave-rmhg krb5kdc[18012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172890, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:10.131317 19145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.117249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:38419 (local address 127.29.82.126:46815)
0808 07:08:10.119516 (+ 2267us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:10.119525 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:10.119557 (+ 32us) server_negotiation.cc:407] Connection header received
0808 07:08:10.119667 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:10.119672 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:10.119713 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:10.119830 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:10.120723 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.121784 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.123221 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.123878 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.123963 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.126599 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:10.126605 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:10.126605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:10.126622 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:10.128740 (+ 2118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:10.129403 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:10.129407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:10.129408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:10.129695 (+ 287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:10.130078 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:10.130079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:10.130080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:10.130437 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:10.130534 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:10.130948 (+ 414us) server_negotiation.cc:299] Negotiation successful
0808 07:08:10.131126 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2197,"thread_start_us":94,"threads_started":1}
I20260808 07:08:10.131318 19144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.117085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:38419)
0808 07:08:10.118740 (+ 1655us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:10.118788 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:10.119317 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:10.119881 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:10.119885 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:10.120373 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:10.120589 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.120595 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.121908 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.121909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.123112 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.123116 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.124102 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.124103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.124249 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.124854 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:10.124865 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:10.126453 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:10.128861 (+ 2408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:10.128872 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:10.128874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:10.129289 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:10.129801 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:10.129802 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:10.129803 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:10.129975 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:10.130520 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:10.130529 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:10.130720 (+ 191us) client_negotiation.cc:769] Sending connection context
0808 07:08:10.130845 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 07:08:10.131074 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1606,"thread_start_us":148,"threads_started":1}
I20260808 07:08:10.132501 19141 heartbeater.cc:347] Connected to a master server at 127.29.82.126:46815
I20260808 07:08:10.132627 19141 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:10.132896 19141 heartbeater.cc:511] Master 127.29.82.126:46815 requested a full tablet report, sending...
I20260808 07:08:10.133843 18866 ts_manager.cc:194] Registered new tserver with Master: ebab049d53db472e8671ff1d31518f9f (127.29.82.65:33171)
I20260808 07:08:10.135103 18866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:38419
I20260808 07:08:10.136253 19141 heartbeater.cc:503] Master 127.29.82.126:46815 was elected leader, sending a full tablet report...
Aug 08 07:08:10 dist-test-slave-rmhg krb5kdc[18012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172889, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for kudu/127.29.82.65@KRBTEST.COM
I20260808 07:08:10.145454 19151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.134549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:33171 (local address 127.0.0.1:47562)
0808 07:08:10.135072 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:10.135119 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:10.135196 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:10.135859 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:10.135868 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:10.136272 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:10.136348 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.136352 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.138013 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.138014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.138882 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.138886 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.139569 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.139570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.139638 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.140137 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:10.140143 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:10.141946 (+ 1803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:10.144144 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:10.144154 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:10.144156 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:10.144385 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:10.144618 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:10.144619 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:10.144619 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:10.144676 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:10.145054 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:10.145063 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:10.145122 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 07:08:10.145250 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 07:08:10.145374 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":116,"threads_started":1}
I20260808 07:08:10.145510 19152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.134863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47562 (local address 127.29.82.65:33171)
0808 07:08:10.135626 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:10.135632 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:10.135643 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:08:10.135678 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:10.135681 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:10.135697 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:10.135768 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:10.136606 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.137920 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.138986 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.139481 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.139554 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.142055 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:10.142067 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:10.142068 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:10.142078 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:10.144033 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:10.144483 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:10.144486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:10.144486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:10.144560 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:10.144724 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:10.144724 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:10.144724 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:10.144934 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:10.145017 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:10.145290 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 07:08:10.145401 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":86,"threads_started":1}
I20260808 07:08:10.146000 19044 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bb78b282ddb40abb3733dc97235bcc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:09 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:47562
I20260808 07:08:10.146792 19154 tablet_replica.cc:330] stopping tablet replica
I20260808 07:08:10.146914 19154 raft_consensus.cc:2229] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:08:10.147013 19154 raft_consensus.cc:2258] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:10.147325 19154 ts_tablet_manager.cc:1905] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:08:10.149714 19154 ts_tablet_manager.cc:1918] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:08:10.149801 19154 log.cc:1196] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal/wals/6bb78b282ddb40abb3733dc97235bcc0
I20260808 07:08:10.150002 19154 ts_tablet_manager.cc:1939] T 6bb78b282ddb40abb3733dc97235bcc0 P ebab049d53db472e8671ff1d31518f9f: Deleting consensus metadata
I20260808 07:08:10.150620 18846 catalog_manager.cc:4841] TS ebab049d53db472e8671ff1d31518f9f (127.29.82.65:33171): tablet 6bb78b282ddb40abb3733dc97235bcc0 (table test-table [id=6dccaf009693419b887798416114ea04]) successfully deleted
W20260808 07:08:10.215404 19147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:10.215643 19147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:10.215667 19147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:10.216897 19147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:10.216955 19147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:10.216996 19147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:08:10.218948 19147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:45409
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=38431
--tserver_master_addrs=127.29.82.126:46815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:10.219187 19147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:10.219383 19147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:10.224448 19171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:10.224443 19163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:10.224443 19166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:10.224705 19147 server_base.cc:1034] running on GCE node
I20260808 07:08:10.224884 19147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:10.225129 19147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:10.226329 19147 hybrid_clock.cc:648] HybridClock initialized: now 1786172890226313 us; error 33 us; skew 500 ppm
Aug 08 07:08:10 dist-test-slave-rmhg krb5kdc[18012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172890, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:10.228821 19147 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:08:10.229316 19147 webserver.cc:460] Webserver started at http://127.29.82.66:38431/ using document root <none> and password file <none>
I20260808 07:08:10.229524 19147 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:10.229580 19147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:10.230886 19147 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:08:10.231458 19179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:10.231619 19147 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:08:10.231707 19147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "1d06d421941b4b969a01b02eaf1f7d91"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "877f4909ac0cef268864dba77bb125e5"
server_key_iv: "956504a6862121880f740be94df78ef3"
server_key_version: "encryptionkey@0"
I20260808 07:08:10.232070 19147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:10.241349 19147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:10.243279 19147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:10.243407 19147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:10.243642 19147 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:10.243953 19147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:10.243997 19147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:10.244028 19147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:10.244046 19147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:10.250065 19147 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:45409
I20260808 07:08:10.250125 19328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:45409 every 8 connection(s)
I20260808 07:08:10.250487 19147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:08:10.251385 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 19147
I20260808 07:08:10.251694 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:36125
--local_ip_for_outbound_sockets=127.29.82.67
--tserver_master_addrs=127.29.82.126:46815
--webserver_port=36739
--webserver_interface=127.29.82.67
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:08:10 dist-test-slave-rmhg krb5kdc[18012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172890, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:10.262225 19145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.251229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:57719 (local address 127.29.82.126:46815)
0808 07:08:10.253286 (+ 2057us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:10.253288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:10.253299 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:08:10.253327 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:10.253328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:10.253341 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:10.253396 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:10.254766 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.255493 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.256520 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.256858 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.256941 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.259337 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:10.259339 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:10.259339 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:10.259348 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:10.260719 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:10.261252 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:10.261253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:10.261253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:10.261309 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:10.261582 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:10.261583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:10.261583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:10.261685 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:10.261731 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:10.262077 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 07:08:10.262156 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2026}
I20260808 07:08:10.262516 19333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.251224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:57719)
0808 07:08:10.251407 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:10.251447 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:10.252019 (+ 572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:10.253567 (+ 1548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:10.253572 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:10.254348 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:10.254654 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.254661 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.255592 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.255593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.256432 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.256434 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.256947 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.256948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.257059 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.257657 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:10.257666 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:10.259208 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:10.260806 (+ 1598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:10.260816 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:10.260819 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:10.261174 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:10.261368 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:10.261369 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:10.261369 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:10.261521 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:10.261741 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:10.261748 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:10.261935 (+ 187us) client_negotiation.cc:769] Sending connection context
0808 07:08:10.262073 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 07:08:10.262264 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":99,"threads_started":1}
I20260808 07:08:10.263098 19330 heartbeater.cc:347] Connected to a master server at 127.29.82.126:46815
I20260808 07:08:10.263201 19330 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:10.263392 19330 heartbeater.cc:511] Master 127.29.82.126:46815 requested a full tablet report, sending...
I20260808 07:08:10.263832 18866 ts_manager.cc:194] Registered new tserver with Master: 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66:45409)
I20260808 07:08:10.264374 18866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:57719
W20260808 07:08:10.339414 19334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:10.339638 19334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:10.339660 19334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:10.340790 19334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:10.340826 19334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:10.340849 19334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:08:10.342357 19334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:36125
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=36739
--tserver_master_addrs=127.29.82.126:46815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:10.342579 19334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:10.342777 19334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:10.347757 19340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:10.347770 19339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:10.347818 19343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:10.348131 19334 server_base.cc:1034] running on GCE node
I20260808 07:08:10.348331 19334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:10.348613 19334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:10.349750 19334 hybrid_clock.cc:648] HybridClock initialized: now 1786172890349739 us; error 29 us; skew 500 ppm
Aug 08 07:08:10 dist-test-slave-rmhg krb5kdc[18012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172890, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:10.352200 19334 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:08:10.352681 19334 webserver.cc:460] Webserver started at http://127.29.82.67:36739/ using document root <none> and password file <none>
I20260808 07:08:10.352890 19334 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:10.352941 19334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:10.354383 19334 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:10.354951 19352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:10.355106 19334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:08:10.355189 19334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "01b87acf79224b128a1bf9e9a32f390a"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "830f9d9b99a8f248ad4c05bace92c899"
server_key_iv: "4343b2b7578c0d965087ff4b250f5597"
server_key_version: "encryptionkey@0"
I20260808 07:08:10.355568 19334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:10.375798 19334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:10.384765 19334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:10.384945 19334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:10.385243 19334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:10.385622 19334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:10.385674 19334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:10.385705 19334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:10.385730 19334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:10.391831 19334 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:36125
I20260808 07:08:10.391875 19515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:36125 every 8 connection(s)
I20260808 07:08:10.392246 19334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:08:10.392675 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 19334
Aug 08 07:08:10 dist-test-slave-rmhg krb5kdc[18012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172890, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:10.399408 19145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.393043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54712 (local address 127.29.82.126:46815)
0808 07:08:10.393093 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:10.393095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:10.393279 (+ 184us) server_negotiation.cc:407] Connection header received
0808 07:08:10.393345 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:10.393346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:10.393359 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:10.393413 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:10.393991 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.394722 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.395450 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.395646 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.395703 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.396880 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:10.396881 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:10.396882 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:10.396889 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:10.398308 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:10.398665 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:10.398667 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:10.398667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:10.398730 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:10.398913 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:10.398914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:10.398914 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:10.399025 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:10.399207 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:10.399244 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 07:08:10.399315 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:08:10.401755 19520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.393316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:46351 (local address 127.29.82.126:46815)
0808 07:08:10.394016 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:10.394018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:10.394023 (+ 5us) server_negotiation.cc:407] Connection header received
0808 07:08:10.394043 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:10.394043 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:10.394053 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:10.394100 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:10.395217 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.395703 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.396688 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.396883 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.396939 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.399065 (+ 2126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:10.399066 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:10.399067 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:10.399074 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:10.400475 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:10.400837 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:10.400838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:10.400839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:10.400894 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:10.401107 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:10.401108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:10.401109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:10.401256 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:10.401312 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:10.401580 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 07:08:10.401662 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":70,"threads_started":1}
I20260808 07:08:10.401928 19519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.393030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:46351)
0808 07:08:10.393217 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:10.393259 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:10.393787 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:10.394207 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:10.394212 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:10.394916 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:10.395131 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.395135 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.395796 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.395797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.396608 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.396611 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.396958 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.396959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.397091 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.397552 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:10.397561 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:10.398975 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:10.400553 (+ 1578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:10.400560 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:10.400562 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:10.400773 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:10.400947 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:10.400948 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:10.400948 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:10.401049 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:10.401311 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:10.401318 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:10.401453 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 07:08:10.401551 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 07:08:10.401714 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260808 07:08:10.402345 19516 heartbeater.cc:347] Connected to a master server at 127.29.82.126:46815
I20260808 07:08:10.402454 19516 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:10.402635 19516 heartbeater.cc:511] Master 127.29.82.126:46815 requested a full tablet report, sending...
I20260808 07:08:10.402998 18866 ts_manager.cc:194] Registered new tserver with Master: 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125)
I20260808 07:08:10.403355 18866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:46351
I20260808 07:08:10.411054 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:08:10.413757 19520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.411407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54714 (local address 127.29.82.126:46815)
0808 07:08:10.411455 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:10.411457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:10.411551 (+ 94us) server_negotiation.cc:407] Connection header received
0808 07:08:10.411624 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:10.411624 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:10.411665 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:10.411726 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:08:10.411829 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.412314 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.413041 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.413301 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.413353 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.413495 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:08:10.413601 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:08:10.413662 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:10.413675 (+ 13us) server_negotiation.cc:299] Negotiation successful
0808 07:08:10.413698 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:08:10.414088 18866 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:54714:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:08:10.415724 18866 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:08:10.418098 19044 tablet_service.cc:1467] Processing CreateTablet for tablet fbac5e3f441c4f1aaa34ce41070ffd95 (DEFAULT_TABLE table=test-table [id=607aedc8d6c347e1ba5a4af8f41a54ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:10.418305 19044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbac5e3f441c4f1aaa34ce41070ffd95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:10.419943 18983 tablet_bootstrap.cc:492] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f: Bootstrap starting.
I20260808 07:08:10.420295 18983 tablet_bootstrap.cc:654] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:10.420971 18983 tablet_bootstrap.cc:492] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f: No bootstrap required, opened a new log
I20260808 07:08:10.421033 18983 ts_tablet_manager.cc:1397] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 07:08:10.421406 19151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.417631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:45409 (local address 127.0.0.1:60736)
0808 07:08:10.417686 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:10.417697 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:10.417734 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:10.418180 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:10.418182 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:10.418184 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:10.418234 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.418235 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.419319 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.419321 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.420189 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.420192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.421126 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.421127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.421226 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.421252 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 07:08:10.421284 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 07:08:10.421332 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 07:08:10.421397 18983 raft_consensus.cc:348] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:10.421460 18983 raft_consensus.cc:374] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:10.421506 18983 raft_consensus.cc:729] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebab049d53db472e8671ff1d31518f9f, State: Initialized, Role: FOLLOWER
I20260808 07:08:10.421556 18983 consensus_queue.cc:260] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:10.421641 18983 ts_tablet_manager.cc:1428] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:10.421795 19525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.417832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60736 (local address 127.29.82.66:45409)
0808 07:08:10.417998 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:10.418003 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:10.418015 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:08:10.418056 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:10.418059 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:10.418077 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:10.418163 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:10.418306 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.419222 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.420282 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.421041 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.421573 (+ 532us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.421646 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:10.421673 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 07:08:10.421716 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":95,"threads_started":1}
I20260808 07:08:10.422180 19522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.417631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:36125 (local address 127.0.0.1:42606)
0808 07:08:10.417839 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:10.417848 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:10.417908 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:10.418622 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:10.418623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:10.418625 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:10.418667 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.418669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.419947 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.419948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.420976 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.420980 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.421946 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.421948 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.422012 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.422016 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:08:10.422070 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 07:08:10.422109 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":20,"thread_start_us":133,"threads_started":1}
I20260808 07:08:10.422194 19527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.418049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42606 (local address 127.29.82.67:36125)
0808 07:08:10.418382 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:10.418387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:10.418397 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:08:10.418488 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:10.418492 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:10.418516 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:10.418727 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:10.418799 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.419823 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.421083 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.421836 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.421931 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.421990 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:10.422084 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 07:08:10.422122 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":85,"threads_started":1}
I20260808 07:08:10.422530 19236 tablet_service.cc:1467] Processing CreateTablet for tablet fbac5e3f441c4f1aaa34ce41070ffd95 (DEFAULT_TABLE table=test-table [id=607aedc8d6c347e1ba5a4af8f41a54ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:10.422878 19236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbac5e3f441c4f1aaa34ce41070ffd95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:10.422780 19420 tablet_service.cc:1467] Processing CreateTablet for tablet fbac5e3f441c4f1aaa34ce41070ffd95 (DEFAULT_TABLE table=test-table [id=607aedc8d6c347e1ba5a4af8f41a54ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:10.423126 19420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbac5e3f441c4f1aaa34ce41070ffd95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:10.425695 19530 tablet_bootstrap.cc:492] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91: Bootstrap starting.
I20260808 07:08:10.426067 19531 tablet_bootstrap.cc:492] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a: Bootstrap starting.
I20260808 07:08:10.426393 19530 tablet_bootstrap.cc:654] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:10.426681 19531 tablet_bootstrap.cc:654] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:10.426963 19530 log.cc:824] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:10.427239 19531 log.cc:824] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:10.427726 19530 tablet_bootstrap.cc:492] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91: No bootstrap required, opened a new log
I20260808 07:08:10.427801 19530 ts_tablet_manager.cc:1397] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:08:10.427980 19531 tablet_bootstrap.cc:492] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a: No bootstrap required, opened a new log
I20260808 07:08:10.428045 19531 ts_tablet_manager.cc:1397] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:08:10.429795 19530 raft_consensus.cc:348] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:10.429989 19530 raft_consensus.cc:374] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:10.429894 19531 raft_consensus.cc:348] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:10.430032 19531 raft_consensus.cc:374] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:10.430029 19530 raft_consensus.cc:729] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d06d421941b4b969a01b02eaf1f7d91, State: Initialized, Role: FOLLOWER
I20260808 07:08:10.430073 19531 raft_consensus.cc:729] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b87acf79224b128a1bf9e9a32f390a, State: Initialized, Role: FOLLOWER
I20260808 07:08:10.430166 19531 consensus_queue.cc:260] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:10.430162 19530 consensus_queue.cc:260] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:10.430464 19530 ts_tablet_manager.cc:1428] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:08:10.430462 19531 ts_tablet_manager.cc:1428] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:08:10.430492 19330 heartbeater.cc:503] Master 127.29.82.126:46815 was elected leader, sending a full tablet report...
I20260808 07:08:10.430562 19516 heartbeater.cc:503] Master 127.29.82.126:46815 was elected leader, sending a full tablet report...
W20260808 07:08:10.501065 19331 tablet.cc:2369] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:08:10.533845 19539 raft_consensus.cc:482] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:08:10.534004 19539 raft_consensus.cc:504] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:10.534379 19539 leader_election.cc:288] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125), ebab049d53db472e8671ff1d31518f9f (127.29.82.65:33171)
I20260808 07:08:10.537246 19333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.534580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:36125 (local address 127.29.82.66:41491)
0808 07:08:10.534630 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:10.534644 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:10.534711 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:10.534860 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:10.534862 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:10.534864 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:10.534933 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.534935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.535574 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.535575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.536357 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.536358 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.536963 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.536965 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.537043 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.537047 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:08:10.537095 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 07:08:10.537138 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260808 07:08:10.537246 19527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.534622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:41491 (local address 127.29.82.67:36125)
0808 07:08:10.534698 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:10.534700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:10.534712 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:08:10.534784 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:10.534785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:10.534796 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:10.534844 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:10.534999 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.535500 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.536452 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.536877 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.536946 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.536956 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:10.537111 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 07:08:10.537176 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 07:08:10.537554 19152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.534769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:60653 (local address 127.29.82.65:33171)
0808 07:08:10.534832 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:10.534834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:10.534948 (+ 114us) server_negotiation.cc:407] Connection header received
0808 07:08:10.535005 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:10.535006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:10.535032 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:10.535087 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:10.535249 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.535768 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.536723 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.537134 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.537228 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.537323 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:10.537425 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 07:08:10.537487 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:08:10.537631 19453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac5e3f441c4f1aaa34ce41070ffd95" candidate_uuid: "1d06d421941b4b969a01b02eaf1f7d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b87acf79224b128a1bf9e9a32f390a" is_pre_election: true
I20260808 07:08:10.537755 19541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.534699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:33171 (local address 127.29.82.66:60653)
0808 07:08:10.534873 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:10.534881 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:10.534951 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:10.535095 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:10.535096 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:10.535098 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:10.535172 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.535173 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.535849 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.535851 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.536629 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:10.536631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.537229 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.537230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:10.537298 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.537302 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:08:10.537636 (+ 334us) client_negotiation.cc:240] Negotiation successful
0808 07:08:10.537682 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":100,"threads_started":1}
I20260808 07:08:10.537822 19453 raft_consensus.cc:2454] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d06d421941b4b969a01b02eaf1f7d91 in term 0.
I20260808 07:08:10.538084 19182 leader_election.cc:302] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b87acf79224b128a1bf9e9a32f390a, 1d06d421941b4b969a01b02eaf1f7d91; no voters:
I20260808 07:08:10.538153 19047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac5e3f441c4f1aaa34ce41070ffd95" candidate_uuid: "1d06d421941b4b969a01b02eaf1f7d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebab049d53db472e8671ff1d31518f9f" is_pre_election: true
I20260808 07:08:10.538232 19539 raft_consensus.cc:2781] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:08:10.538305 19539 raft_consensus.cc:482] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:08:10.538304 19047 raft_consensus.cc:2454] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d06d421941b4b969a01b02eaf1f7d91 in term 0.
I20260808 07:08:10.538338 19539 raft_consensus.cc:3037] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:10.539050 19539 raft_consensus.cc:504] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:10.539165 19539 leader_election.cc:288] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [CANDIDATE]: Term 1 election: Requested vote from peers 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125), ebab049d53db472e8671ff1d31518f9f (127.29.82.65:33171)
I20260808 07:08:10.539337 19453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac5e3f441c4f1aaa34ce41070ffd95" candidate_uuid: "1d06d421941b4b969a01b02eaf1f7d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01b87acf79224b128a1bf9e9a32f390a"
I20260808 07:08:10.539356 19047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbac5e3f441c4f1aaa34ce41070ffd95" candidate_uuid: "1d06d421941b4b969a01b02eaf1f7d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebab049d53db472e8671ff1d31518f9f"
I20260808 07:08:10.539422 19047 raft_consensus.cc:3037] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:10.539424 19453 raft_consensus.cc:3037] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:10.540274 19047 raft_consensus.cc:2454] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d06d421941b4b969a01b02eaf1f7d91 in term 1.
I20260808 07:08:10.540274 19453 raft_consensus.cc:2454] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d06d421941b4b969a01b02eaf1f7d91 in term 1.
I20260808 07:08:10.540493 19182 leader_election.cc:302] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01b87acf79224b128a1bf9e9a32f390a, 1d06d421941b4b969a01b02eaf1f7d91; no voters:
I20260808 07:08:10.540593 19539 raft_consensus.cc:2781] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:08:10.540786 19539 raft_consensus.cc:686] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [term 1 LEADER]: Becoming Leader. State: Replica: 1d06d421941b4b969a01b02eaf1f7d91, State: Running, Role: LEADER
I20260808 07:08:10.540875 19539 consensus_queue.cc:237] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:10.541775 18865 catalog_manager.cc:5495] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66). New cstate: current_term: 1 leader_uuid: "1d06d421941b4b969a01b02eaf1f7d91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } health_report { overall_health: UNKNOWN } } }
I20260808 07:08:10.566990 19525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.564823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60740 (local address 127.29.82.66:45409)
0808 07:08:10.564868 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:10.564870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:10.564894 (+ 24us) server_negotiation.cc:407] Connection header received
0808 07:08:10.564930 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:10.564931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:10.564950 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:10.565003 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:08:10.565100 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.565635 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.566332 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:10.566570 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:10.566625 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:10.566716 (+ 91us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:08:10.566820 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:08:10.566873 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:10.566888 (+ 15us) server_negotiation.cc:299] Negotiation successful
0808 07:08:10.566906 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:08:10.569021 19453 raft_consensus.cc:1261] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a [term 1 FOLLOWER]: Refusing update from remote peer 1d06d421941b4b969a01b02eaf1f7d91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:08:10.568998 19047 raft_consensus.cc:1261] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Refusing update from remote peer 1d06d421941b4b969a01b02eaf1f7d91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:08:10.569502 19539 consensus_queue.cc:1035] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:08:10.569651 19542 consensus_queue.cc:1035] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:08:10.572266 19550 mvcc.cc:205] Tried to move back new op lower bound from 7316164159767531520 to 7316164159656038400. Current Snapshot: MvccSnapshot[applied={T|T < 7316164159767531520}]
I20260808 07:08:10.572414 19548 mvcc.cc:205] Tried to move back new op lower bound from 7316164159767531520 to 7316164159656038400. Current Snapshot: MvccSnapshot[applied={T|T < 7316164159767531520}]
I20260808 07:08:10.572072 19549 mvcc.cc:205] Tried to move back new op lower bound from 7316164159767531520 to 7316164159656038400. Current Snapshot: MvccSnapshot[applied={T|T < 7316164159767531520}]
I20260808 07:08:10.575026 18865 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:54714:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:08:10.575134 18865 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:54714:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:08:10.575954 18865 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Sending DeleteTablet for 3 replicas of tablet fbac5e3f441c4f1aaa34ce41070ffd95
I20260808 07:08:10.576265 19236 tablet_service.cc:1514] Processing DeleteTablet for tablet fbac5e3f441c4f1aaa34ce41070ffd95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:10 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:60736
I20260808 07:08:10.576305 19044 tablet_service.cc:1514] Processing DeleteTablet for tablet fbac5e3f441c4f1aaa34ce41070ffd95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:10 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:47562
I20260808 07:08:10.576359 19420 tablet_service.cc:1514] Processing DeleteTablet for tablet fbac5e3f441c4f1aaa34ce41070ffd95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:10 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:42606
I20260808 07:08:10.576428 19154 tablet_replica.cc:330] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f: stopping tablet replica
I20260808 07:08:10.576493 19154 raft_consensus.cc:2229] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:08:10.576546 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 18918
I20260808 07:08:10.576565 19154 raft_consensus.cc:2258] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:10.576588 19560 tablet_replica.cc:330] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a: stopping tablet replica
I20260808 07:08:10.584570 19560 raft_consensus.cc:2229] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:08:10.584764 19560 raft_consensus.cc:2258] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:10.585978 19560 ts_tablet_manager.cc:1905] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:08:10.587474 19559 tablet_replica.cc:330] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91: stopping tablet replica
I20260808 07:08:10.587611 19559 raft_consensus.cc:2229] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:08:10.587743 19559 raft_consensus.cc:2258] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:10.589663 19559 ts_tablet_manager.cc:1905] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:08:10.589867 19560 ts_tablet_manager.cc:1918] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:08:10.589957 19560 log.cc:1196] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/fbac5e3f441c4f1aaa34ce41070ffd95
I20260808 07:08:10.590267 19560 ts_tablet_manager.cc:1939] T fbac5e3f441c4f1aaa34ce41070ffd95 P 01b87acf79224b128a1bf9e9a32f390a: Deleting consensus metadata
I20260808 07:08:10.590767 18846 catalog_manager.cc:4841] TS 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125): tablet fbac5e3f441c4f1aaa34ce41070ffd95 (table test-table [id=607aedc8d6c347e1ba5a4af8f41a54ff]) successfully deleted
I20260808 07:08:10.591284 19559 ts_tablet_manager.cc:1918] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:08:10.591348 19559 log.cc:1196] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/fbac5e3f441c4f1aaa34ce41070ffd95
I20260808 07:08:10.591605 19559 ts_tablet_manager.cc:1939] T fbac5e3f441c4f1aaa34ce41070ffd95 P 1d06d421941b4b969a01b02eaf1f7d91: Deleting consensus metadata
I20260808 07:08:10.592011 18848 catalog_manager.cc:4841] TS 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66:45409): tablet fbac5e3f441c4f1aaa34ce41070ffd95 (table test-table [id=607aedc8d6c347e1ba5a4af8f41a54ff]) successfully deleted
W20260808 07:08:10.594166 18846 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:33171 (error 108)
I20260808 07:08:10.594575 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 19147
I20260808 07:08:10.594712 19522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.594574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:33171 (local address 127.0.0.1:47572)
0808 07:08:10.594636 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:10.594678 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:33171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 07:08:10.598922 18846 catalog_manager.cc:4584] TS ebab049d53db472e8671ff1d31518f9f (127.29.82.65:33171): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fbac5e3f441c4f1aaa34ce41070ffd95: Network error: Client connection negotiation failed: client connection to 127.29.82.65:33171: connect: Connection refused (error 111)
I20260808 07:08:10.611745 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 19334
I20260808 07:08:10.622761 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 18822
I20260808 07:08:10.636251 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:46815
--webserver_interface=127.29.82.126
--webserver_port=38009
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:46815
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:10.719791 19563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:10.720016 19563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:10.720048 19563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:10.721292 19563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:08:10.721335 19563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:10.721354 19563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:10.721370 19563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:08:10.721387 19563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:08:10.722949 19563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:46815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:46815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=38009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:10.723214 19563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:10.723448 19563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:10.728335 19572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:10.728345 19576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:10.728336 19573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:10.728590 19563 server_base.cc:1034] running on GCE node
I20260808 07:08:10.728808 19563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:10.729061 19563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:10.730224 19563 hybrid_clock.cc:648] HybridClock initialized: now 1786172890730217 us; error 45 us; skew 500 ppm
Aug 08 07:08:10 dist-test-slave-rmhg krb5kdc[18012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172890, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:10.732807 19563 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:08:10.733323 19563 webserver.cc:460] Webserver started at http://127.29.82.126:38009/ using document root <none> and password file <none>
I20260808 07:08:10.733600 19563 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:10.733656 19563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:10.734994 19563 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:10.735652 19584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:10.735816 19563 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:08:10.735913 19563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "ec4e2949f1b6449db6fc25599b93c27c"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "c8e82f6d39f6ad05c14ad2d224bf7062"
server_key_iv: "bda570bc009c141a785c52f23f16a8b5"
server_key_version: "encryptionkey@0"
I20260808 07:08:10.736261 19563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:10.756145 19563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:10.758364 19563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:10.758522 19563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:10.762813 19563 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:46815
I20260808 07:08:10.762857 19656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:46815 every 8 connection(s)
I20260808 07:08:10.763244 19563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:08:10.764842 19657 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:08:10.765519 19657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Bootstrap starting.
I20260808 07:08:10.772086 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 19563
I20260808 07:08:10.772464 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:33171
--local_ip_for_outbound_sockets=127.29.82.65
--tserver_master_addrs=127.29.82.126:46815
--webserver_port=36639
--webserver_interface=127.29.82.65
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:08:10.774523 19657 log.cc:824] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:10.776950 19657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:08:10.777326 19657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c: Bootstrap complete.
I20260808 07:08:10.779518 19657 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } }
I20260808 07:08:10.779757 19657 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4e2949f1b6449db6fc25599b93c27c, State: Initialized, Role: FOLLOWER
I20260808 07:08:10.779906 19657 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } }
I20260808 07:08:10.779978 19657 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:08:10.780030 19657 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:08:10.780081 19657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:08:10.781217 19657 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } }
I20260808 07:08:10.781322 19657 leader_election.cc:302] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec4e2949f1b6449db6fc25599b93c27c; no voters:
I20260808 07:08:10.781502 19657 leader_election.cc:288] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 07:08:10.781550 19662 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 3 FOLLOWER]: Leader election won for term 3
I20260808 07:08:10.781673 19662 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [term 3 LEADER]: Becoming Leader. State: Replica: ec4e2949f1b6449db6fc25599b93c27c, State: Running, Role: LEADER
I20260808 07:08:10.781771 19662 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } }
I20260808 07:08:10.781796 19657 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:08:10.782127 19665 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec4e2949f1b6449db6fc25599b93c27c. Latest consensus state: current_term: 3 leader_uuid: "ec4e2949f1b6449db6fc25599b93c27c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } } }
I20260808 07:08:10.782210 19665 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:10.782493 19664 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ec4e2949f1b6449db6fc25599b93c27c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4e2949f1b6449db6fc25599b93c27c" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 46815 } } }
I20260808 07:08:10.782564 19664 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec4e2949f1b6449db6fc25599b93c27c [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:10.782549 19669 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:08:10.783519 19669 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:08:10.783638 19669 catalog_manager.cc:1259] Loaded cluster ID: c5c30edea4cf4e0289f22ac5b4299707
I20260808 07:08:10.783886 19669 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 07:08:10.784222 19669 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f38950569ad google::LogMessage::Fail() at ??:0
@ 0x7f389505988a google::LogMessage::SendToLog() at ??:0
@ 0x7f38950564de google::LogMessage::Flush() at ??:0
@ 0x7f3895057a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f389cf770f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f389cf808b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f3896f240d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f3896f19954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f3897d7d6db start_thread at ??:0
@ 0x7f3893b5461f clone at ??:0
W20260808 07:08:10.868896 19659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:10.869112 19659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:10.869187 19659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:10.870499 19659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:10.870555 19659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:10.870595 19659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:08:10.872169 19659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:33171
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=36639
--tserver_master_addrs=127.29.82.126:46815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:10.872432 19659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:10.872658 19659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:10.877849 19717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:10.877849 19712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:10.878145 19713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:10.878139 19659 server_base.cc:1034] running on GCE node
I20260808 07:08:10.878404 19659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:10.878785 19659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:10.879976 19659 hybrid_clock.cc:648] HybridClock initialized: now 1786172890879953 us; error 40 us; skew 500 ppm
Aug 08 07:08:10 dist-test-slave-rmhg krb5kdc[18012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172890, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:10.883173 19659 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:08:10.883801 19659 webserver.cc:460] Webserver started at http://127.29.82.65:36639/ using document root <none> and password file <none>
I20260808 07:08:10.884084 19659 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:10.884158 19659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:10.886119 19659 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:08:10.886942 19727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:10.887113 19659 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:10.887209 19659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "ebab049d53db472e8671ff1d31518f9f"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "9ac54660e6dcd36fb3ad44ded5538315"
server_key_iv: "4a2102df71d13de04f8c2152707a2c83"
server_key_version: "encryptionkey@0"
I20260808 07:08:10.887575 19659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:10.898247 19659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:10.900578 19659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:10.900700 19659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:10.900947 19659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:10.901433 19736 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 07:08:10.903451 19659 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 07:08:10.903512 19659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 07:08:10.903556 19659 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 07:08:10.904230 19659 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 07:08:10.904263 19659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 07:08:10.904363 19736 tablet_bootstrap.cc:492] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f: Bootstrap starting.
I20260808 07:08:10.912591 19659 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:33171
I20260808 07:08:10.912645 19881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:33171 every 8 connection(s)
I20260808 07:08:10.913177 19659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:08:10.915256 19736 log.cc:824] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:10.917452 19736 tablet_bootstrap.cc:492] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:08:10.917725 19736 tablet_bootstrap.cc:492] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f: Bootstrap complete.
I20260808 07:08:10.918480 19736 ts_tablet_manager.cc:1397] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.009s
I20260808 07:08:10.919214 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 19659
I20260808 07:08:10.919476 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:45409
--local_ip_for_outbound_sockets=127.29.82.66
--tserver_master_addrs=127.29.82.126:46815
--webserver_port=38431
--webserver_interface=127.29.82.66
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:08:10.919734 19736 raft_consensus.cc:348] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:10.919996 19736 raft_consensus.cc:729] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebab049d53db472e8671ff1d31518f9f, State: Initialized, Role: FOLLOWER
I20260808 07:08:10.920156 19736 consensus_queue.cc:260] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:10.920470 19736 ts_tablet_manager.cc:1428] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260808 07:08:10.995464 19887 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:08:10.914067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:37041)
0808 07:08:10.914307 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:10.914362 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:10.915011 (+ 649us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:10.995236 (+ 80225us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":112,"threads_started":1}
W20260808 07:08:10.995749 19884 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:46815 (0 consecutive failures): Network error: Failed to ping master at 127.29.82.126:46815: Client connection negotiation failed: client connection to 127.29.82.126:46815: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:08:10.996129 19887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.995968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:55373)
0808 07:08:10.996031 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:10.996095 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 07:08:10.996474 19887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:10.996377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:35917)
0808 07:08:10.996423 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:10.996453 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 07:08:10.996595 19884 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:08:11.024597 19890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:11.024822 19890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:11.024847 19890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:11.026120 19890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:11.026167 19890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:11.026194 19890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:08:11.027717 19890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:45409
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=38431
--tserver_master_addrs=127.29.82.126:46815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:11.027956 19890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:11.028187 19890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:11.033241 19895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:11.033370 19890 server_base.cc:1034] running on GCE node
W20260808 07:08:11.033215 19897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:11.033226 19901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:11.033639 19890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:11.033869 19890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:11.035048 19890 hybrid_clock.cc:648] HybridClock initialized: now 1786172891035033 us; error 27 us; skew 500 ppm
Aug 08 07:08:11 dist-test-slave-rmhg krb5kdc[18012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172891, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:11.037629 19890 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:08:11.038106 19890 webserver.cc:460] Webserver started at http://127.29.82.66:38431/ using document root <none> and password file <none>
I20260808 07:08:11.038319 19890 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:11.038370 19890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:11.039738 19890 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:11.040369 19910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:11.040537 19890 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:08:11.040655 19890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "1d06d421941b4b969a01b02eaf1f7d91"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "877f4909ac0cef268864dba77bb125e5"
server_key_iv: "956504a6862121880f740be94df78ef3"
server_key_version: "encryptionkey@0"
I20260808 07:08:11.041015 19890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:11.053718 19890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:11.055765 19890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:11.055914 19890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:11.056165 19890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:11.056481 19890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:11.056516 19890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:11.056546 19890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:11.056572 19890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:11.062839 19890 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:45409
I20260808 07:08:11.062882 20073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:45409 every 8 connection(s)
I20260808 07:08:11.063258 19890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:08:11.064344 20077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:11.063933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:60357)
0808 07:08:11.064104 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:11.064193 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":87,"threads_started":1}
W20260808 07:08:11.064803 20075 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:46815 (0 consecutive failures): Network error: Failed to ping master at 127.29.82.126:46815: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
I20260808 07:08:11.065093 20077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:11.065002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:47527)
0808 07:08:11.065044 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:11.065073 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 07:08:11.065372 20077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:11.065305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:60875)
0808 07:08:11.065335 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:11.065356 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260808 07:08:11.065464 20075 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 07:08:11.066820 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 19890
I20260808 07:08:11.067044 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:36125
--local_ip_for_outbound_sockets=127.29.82.67
--tserver_master_addrs=127.29.82.126:46815
--webserver_port=36739
--webserver_interface=127.29.82.67
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:11.151386 20079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:11.151618 20079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:11.151643 20079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:11.152872 20079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:11.152922 20079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:11.152956 20079 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:08:11.154517 20079 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:36125
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=36739
--tserver_master_addrs=127.29.82.126:46815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:11.154776 20079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:11.155030 20079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:11.160254 20087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:11.160257 20086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:11.160277 20089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:11.160353 20079 server_base.cc:1034] running on GCE node
I20260808 07:08:11.160686 20079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:11.160931 20079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:11.162096 20079 hybrid_clock.cc:648] HybridClock initialized: now 1786172891162077 us; error 36 us; skew 500 ppm
Aug 08 07:08:11 dist-test-slave-rmhg krb5kdc[18012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172891, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:11.164635 20079 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:08:11.165091 20079 webserver.cc:460] Webserver started at http://127.29.82.67:36739/ using document root <none> and password file <none>
I20260808 07:08:11.165316 20079 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:11.165369 20079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:11.166728 20079 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:11.167306 20099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:11.167479 20079 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:08:11.167572 20079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "01b87acf79224b128a1bf9e9a32f390a"
format_stamp: "Formatted at 2026-08-08 07:08:09 on dist-test-slave-rmhg"
server_key: "830f9d9b99a8f248ad4c05bace92c899"
server_key_iv: "4343b2b7578c0d965087ff4b250f5597"
server_key_version: "encryptionkey@0"
I20260808 07:08:11.167917 20079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:11.175644 20079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:11.177781 20079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:11.177928 20079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:11.178164 20079 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:11.178511 20079 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:11.178550 20079 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:11.178578 20079 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:11.178604 20079 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:11.184319 20079 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:36125
I20260808 07:08:11.184360 20252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:36125 every 8 connection(s)
I20260808 07:08:11.184737 20079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:08:11.185889 20258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:11.185499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:55613)
0808 07:08:11.185660 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:11.185740 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
W20260808 07:08:11.186283 20255 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:46815 (0 consecutive failures): Network error: Failed to ping master at 127.29.82.126:46815: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
I20260808 07:08:11.186537 20258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:11.186450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:43523)
0808 07:08:11.186490 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:11.186521 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 07:08:11.186750 20258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:11.186689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:45287)
0808 07:08:11.186720 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:11.186738 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260808 07:08:11.186832 20255 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 07:08:11.193419 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 20079
I20260808 07:08:11.997328 20262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:11.997008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:52291)
0808 07:08:11.997197 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:11.997256 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":71,"threads_started":1}
I20260808 07:08:12.065968 20263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:12.065765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:51211)
0808 07:08:12.065878 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:12.065915 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":63,"threads_started":1}
I20260808 07:08:12.187383 20264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:12.187173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:32899)
0808 07:08:12.187294 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:12.187333 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
I20260808 07:08:12.689935 20265 raft_consensus.cc:482] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:08:12.690065 20265 raft_consensus.cc:504] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:12.690447 20265 leader_election.cc:288] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66:45409), 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125)
Aug 08 07:08:12 dist-test-slave-rmhg krb5kdc[18012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172890, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.66@KRBTEST.COM
Aug 08 07:08:12 dist-test-slave-rmhg krb5kdc[18012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172890, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.67@KRBTEST.COM
I20260808 07:08:12.704660 20268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:12.690724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:50415 (local address 127.29.82.66:45409)
0808 07:08:12.690876 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:12.690888 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:12.690910 (+ 22us) server_negotiation.cc:407] Connection header received
0808 07:08:12.691378 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:12.691380 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:12.691423 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:12.691582 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:12.692359 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:12.693304 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:12.694351 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:12.694749 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:12.694847 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:12.701356 (+ 6509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:12.701361 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:12.701361 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:12.701373 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:12.703061 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:12.703479 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:12.703482 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:12.703483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:12.703578 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:12.703797 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:12.703798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:12.703798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:12.704045 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:12.704118 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:12.704396 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 07:08:12.704548 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":54,"threads_started":1}
I20260808 07:08:12.704663 20267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:12.690604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:36125 (local address 127.29.82.65:44817)
0808 07:08:12.690753 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:12.690765 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:12.690823 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:12.691628 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:12.691631 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:12.692041 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:12.692246 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:12.692252 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:12.693463 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:12.693464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:12.694263 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:12.694265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:12.694836 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:12.694837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:12.694951 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:12.699644 (+ 4693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:12.699654 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:12.701605 (+ 1951us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:12.703247 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:12.703249 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:12.703249 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:12.703456 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:12.703682 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:12.703683 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:12.703683 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:12.703745 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:12.704112 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:12.704119 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:12.704248 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 07:08:12.704336 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 07:08:12.704567 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":39,"thread_start_us":78,"threads_started":1}
I20260808 07:08:12.704684 20269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:12.690823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:44817 (local address 127.29.82.67:36125)
0808 07:08:12.690929 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:12.690940 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:12.690959 (+ 19us) server_negotiation.cc:407] Connection header received
0808 07:08:12.691401 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:12.691404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:12.691455 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:12.691582 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:12.692359 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:12.693343 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:12.694345 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:12.694750 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:12.694846 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:12.701720 (+ 6874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:12.701725 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:12.701725 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:12.701737 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:12.703152 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:12.703530 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:12.703534 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:12.703534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:12.703621 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:12.703796 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:12.703797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:12.703798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:12.704046 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:12.704118 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:12.704403 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 07:08:12.704556 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71,"thread_start_us":50,"threads_started":1}
I20260808 07:08:12.704756 20266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:12.690611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:45409 (local address 127.29.82.65:50415)
0808 07:08:12.690766 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:12.690777 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:12.690830 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:12.691628 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:12.691631 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:12.692039 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:12.692246 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:12.692252 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:12.693406 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:12.693408 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:12.694263 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:12.694266 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:12.694832 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:12.694833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:12.694950 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:12.699645 (+ 4695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:12.699657 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:12.701238 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:12.703142 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:12.703150 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:12.703152 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:12.703403 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:12.703637 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:12.703638 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:12.703638 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:12.703741 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:12.704110 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:12.704117 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:12.704248 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 07:08:12.704336 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 07:08:12.704641 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":190,"thread_start_us":87,"threads_started":1}
W20260808 07:08:12.705593 19729 leader_election.cc:341] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125): Not found: Tablet not found: fbac5e3f441c4f1aaa34ce41070ffd95
W20260808 07:08:12.705684 19733 leader_election.cc:341] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66:45409): Not found: Tablet not found: fbac5e3f441c4f1aaa34ce41070ffd95
I20260808 07:08:12.705736 19733 leader_election.cc:302] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebab049d53db472e8671ff1d31518f9f; no voters: 01b87acf79224b128a1bf9e9a32f390a, 1d06d421941b4b969a01b02eaf1f7d91
I20260808 07:08:12.705827 20265 raft_consensus.cc:2726] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:08:12.998025 20267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:12.997869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:45149)
0808 07:08:12.997935 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:12.997982 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 07:08:13.066803 20270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:13.066493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:32941)
0808 07:08:13.066685 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:13.066747 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":94,"threads_started":1}
I20260808 07:08:13.188136 20272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:13.187868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:40465)
0808 07:08:13.188026 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:13.188084 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":70,"threads_started":1}
I20260808 07:08:13.998766 20273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:13.998542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:46533)
0808 07:08:13.998674 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:13.998715 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
I20260808 07:08:14.067567 20274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:14.067302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:46507)
0808 07:08:14.067466 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:14.067507 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":88,"threads_started":1}
I20260808 07:08:14.188863 20275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:14.188628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:40493)
0808 07:08:14.188775 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:14.188817 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":70,"threads_started":1}
I20260808 07:08:14.870141 20278 raft_consensus.cc:482] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:08:14.870244 20278 raft_consensus.cc:504] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:14.870390 20278 leader_election.cc:288] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66:45409), 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125)
W20260808 07:08:14.870891 19729 leader_election.cc:341] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125): Not found: Tablet not found: fbac5e3f441c4f1aaa34ce41070ffd95
W20260808 07:08:14.870973 19733 leader_election.cc:341] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66:45409): Not found: Tablet not found: fbac5e3f441c4f1aaa34ce41070ffd95
I20260808 07:08:14.871052 19733 leader_election.cc:302] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebab049d53db472e8671ff1d31518f9f; no voters: 01b87acf79224b128a1bf9e9a32f390a, 1d06d421941b4b969a01b02eaf1f7d91
I20260808 07:08:14.871134 20278 raft_consensus.cc:2726] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:08:14.999585 20279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:14.999266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:50327)
0808 07:08:14.999407 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:14.999515 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":67,"threads_started":1}
I20260808 07:08:15.068323 20280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:15.068081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:42499)
0808 07:08:15.068218 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:15.068258 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":65,"threads_started":1}
I20260808 07:08:15.189718 20282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:15.189458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:50095)
0808 07:08:15.189606 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:15.189651 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":66,"threads_started":1}
I20260808 07:08:16.000408 20284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:16.000116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:39413)
0808 07:08:16.000312 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:16.000359 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":84,"threads_started":1}
I20260808 07:08:16.069106 20287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:16.068836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:34519)
0808 07:08:16.069001 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:16.069046 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":70,"threads_started":1}
I20260808 07:08:16.190456 20288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:16.190241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:37489)
0808 07:08:16.190371 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:16.190409 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":77,"threads_started":1}
I20260808 07:08:17.001209 20289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:17.000950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:37015)
0808 07:08:17.001089 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:17.001125 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":63,"threads_started":1}
I20260808 07:08:17.069868 20290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:17.069619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:37255)
0808 07:08:17.069769 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:17.069817 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":66,"threads_started":1}
I20260808 07:08:17.191205 20292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:17.190983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:60701)
0808 07:08:17.191121 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:17.191158 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":71,"threads_started":1}
I20260808 07:08:17.319413 20293 raft_consensus.cc:482] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:08:17.319512 20293 raft_consensus.cc:504] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:17.319679 20293 leader_election.cc:288] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66:45409), 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125)
W20260808 07:08:17.320063 19733 leader_election.cc:341] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66:45409): Not found: Tablet not found: fbac5e3f441c4f1aaa34ce41070ffd95
W20260808 07:08:17.320148 19729 leader_election.cc:341] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125): Not found: Tablet not found: fbac5e3f441c4f1aaa34ce41070ffd95
I20260808 07:08:17.320210 19729 leader_election.cc:302] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebab049d53db472e8671ff1d31518f9f; no voters: 01b87acf79224b128a1bf9e9a32f390a, 1d06d421941b4b969a01b02eaf1f7d91
I20260808 07:08:17.320292 20293 raft_consensus.cc:2726] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:08:18.002015 20294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:18.001779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:53971)
0808 07:08:18.001913 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:18.001965 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
I20260808 07:08:18.070581 20296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:18.070334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:43311)
0808 07:08:18.070490 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:18.070530 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":67,"threads_started":1}
I20260808 07:08:18.191980 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:18.191702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:47779)
0808 07:08:18.191872 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:18.191931 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":86,"threads_started":1}
I20260808 07:08:19.002835 20298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:19.002563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:55883)
0808 07:08:19.002742 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:19.002786 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":86,"threads_started":1}
I20260808 07:08:19.071373 20300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:19.071097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:46073)
0808 07:08:19.071274 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:19.071322 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":79,"threads_started":1}
I20260808 07:08:19.192723 20302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:19.192484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:43457)
0808 07:08:19.192630 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:19.192672 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":66,"threads_started":1}
I20260808 07:08:20.003528 20303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:20.003323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:38085)
0808 07:08:20.003447 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:20.003477 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":66,"threads_started":1}
I20260808 07:08:20.072089 20304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:20.071825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:36971)
0808 07:08:20.071989 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:20.072038 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":65,"threads_started":1}
I20260808 07:08:20.193416 20305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:20.193173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:33537)
0808 07:08:20.193329 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:20.193367 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":64,"threads_started":1}
I20260808 07:08:21.004339 20306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:21.004079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:52127)
0808 07:08:21.004237 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:21.004288 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":69,"threads_started":1}
I20260808 07:08:21.072788 20307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:21.072577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:40187)
0808 07:08:21.072695 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:21.072736 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":61,"threads_started":1}
I20260808 07:08:21.194053 20310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:21.193826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:49029)
0808 07:08:21.193961 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:21.194000 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":78,"threads_started":1}
I20260808 07:08:22.005142 20312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:22.004869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:50353)
0808 07:08:22.005041 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:22.005090 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":72,"threads_started":1}
I20260808 07:08:22.073493 20313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:22.073247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:45905)
0808 07:08:22.073368 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:22.073412 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":60,"threads_started":1}
I20260808 07:08:22.167281 20316 raft_consensus.cc:482] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:08:22.167392 20316 raft_consensus.cc:504] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d06d421941b4b969a01b02eaf1f7d91" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45409 } } peers { permanent_uuid: "01b87acf79224b128a1bf9e9a32f390a" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 36125 } } peers { permanent_uuid: "ebab049d53db472e8671ff1d31518f9f" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33171 } }
I20260808 07:08:22.167570 20316 leader_election.cc:288] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66:45409), 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125)
W20260808 07:08:22.167972 19729 leader_election.cc:341] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01b87acf79224b128a1bf9e9a32f390a (127.29.82.67:36125): Not found: Tablet not found: fbac5e3f441c4f1aaa34ce41070ffd95
W20260808 07:08:22.168051 19733 leader_election.cc:341] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d06d421941b4b969a01b02eaf1f7d91 (127.29.82.66:45409): Not found: Tablet not found: fbac5e3f441c4f1aaa34ce41070ffd95
I20260808 07:08:22.168124 19733 leader_election.cc:302] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebab049d53db472e8671ff1d31518f9f; no voters: 01b87acf79224b128a1bf9e9a32f390a, 1d06d421941b4b969a01b02eaf1f7d91
I20260808 07:08:22.168210 20316 raft_consensus.cc:2726] T fbac5e3f441c4f1aaa34ce41070ffd95 P ebab049d53db472e8671ff1d31518f9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:08:22.194731 20317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:22.194492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:36309)
0808 07:08:22.194645 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:22.194685 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260808 07:08:23.005910 20318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:23.005676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:48249)
0808 07:08:23.005816 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:23.005860 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
I20260808 07:08:23.074177 20319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:23.073950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:53383)
0808 07:08:23.074082 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:23.074127 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":63,"threads_started":1}
I20260808 07:08:23.195385 20321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:23.195166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:50129)
0808 07:08:23.195296 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:23.195336 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":64,"threads_started":1}
I20260808 07:08:24.006731 20322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:24.006436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:50949)
0808 07:08:24.006629 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:24.006680 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":99,"threads_started":1}
I20260808 07:08:24.074952 20324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:24.074673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:40653)
0808 07:08:24.074836 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:24.074882 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":65,"threads_started":1}
I20260808 07:08:24.196152 20325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:24.195904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:42085)
0808 07:08:24.196057 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:24.196102 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":77,"threads_started":1}
I20260808 07:08:25.007634 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:25.007333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:57753)
0808 07:08:25.007529 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:25.007577 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":92,"threads_started":1}
I20260808 07:08:25.075747 20327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:25.075499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:47513)
0808 07:08:25.075645 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:25.075696 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":69,"threads_started":1}
I20260808 07:08:25.196980 20328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:25.196725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:53299)
0808 07:08:25.196877 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:25.196925 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":69,"threads_started":1}
I20260808 07:08:26.008455 20329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:26.008213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.65:38039)
0808 07:08:26.008367 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:26.008406 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":84,"threads_started":1}
I20260808 07:08:26.076618 20330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:26.076352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.66:35133)
0808 07:08:26.076522 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:26.076569 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":88,"threads_started":1}
I20260808 07:08:26.196094 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 19659
I20260808 07:08:26.203474 20331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:26.202261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:46815 (local address 127.29.82.67:57015)
0808 07:08:26.203389 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:26.203426 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:46815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1106,"thread_start_us":1063,"threads_started":1}
I20260808 07:08:26.208143 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 19890
I20260808 07:08:26.214867 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 20079
2026-08-08T07:08:26Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18478 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:08:26 dist-test-slave-rmhg krb5kdc[20336](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:08:26 dist-test-slave-rmhg krb5kdc[20336](info): set up 2 sockets
Aug 08 07:08:26 dist-test-slave-rmhg krb5kdc[20336](info): commencing operation
krb5kdc: starting...
W20260808 07:08:27.357729 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:08:27 dist-test-slave-rmhg krb5kdc[20336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172907, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:08:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:08:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:08:27.483697 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:34571
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:34571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:27.568097 20357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:27.568334 20357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:27.568365 20357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:27.569605 20357 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 07:08:27.569649 20357 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 07:08:27.569666 20357 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 07:08:27.569680 20357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:08:27.569697 20357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:27.569715 20357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:27.569731 20357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:08:27.569754 20357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:08:27.571348 20357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:34571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:34571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:27.571627 20357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:27.571852 20357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:27.577368 20362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:27.577414 20363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:27.577410 20357 server_base.cc:1034] running on GCE node
W20260808 07:08:27.577373 20365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:27.577976 20357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:27.578317 20357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:27.579495 20357 hybrid_clock.cc:648] HybridClock initialized: now 1786172907579478 us; error 42 us; skew 500 ppm
Aug 08 07:08:27 dist-test-slave-rmhg krb5kdc[20336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172907, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:27.582049 20357 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:08:27.582533 20357 webserver.cc:460] Webserver started at http://127.29.82.126:38741/ using document root <none> and password file <none>
I20260808 07:08:27.582755 20357 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:27.582803 20357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:27.582938 20357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:08:27.584021 20357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "75048b4ce01c4a99a22c3ca214e60c7e"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "7f2debf3a9b589f1110ab2e35888eff1"
server_key_iv: "3a40c739402d8cc5c4147a33d3401e5f"
server_key_version: "encryptionkey@0"
I20260808 07:08:27.584367 20357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "75048b4ce01c4a99a22c3ca214e60c7e"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "7f2debf3a9b589f1110ab2e35888eff1"
server_key_iv: "3a40c739402d8cc5c4147a33d3401e5f"
server_key_version: "encryptionkey@0"
I20260808 07:08:27.585803 20357 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:08:27.586601 20373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:27.586784 20357 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:27.586881 20357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "75048b4ce01c4a99a22c3ca214e60c7e"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "7f2debf3a9b589f1110ab2e35888eff1"
server_key_iv: "3a40c739402d8cc5c4147a33d3401e5f"
server_key_version: "encryptionkey@0"
I20260808 07:08:27.586954 20357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:27.600876 20357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:27.602895 20357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:27.603050 20357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:27.607352 20357 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:34571
I20260808 07:08:27.607396 20452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:34571 every 8 connection(s)
I20260808 07:08:27.607755 20357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:08:27.608654 20453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:27.609642 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 20357
I20260808 07:08:27.609759 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:08:27.609954 30025 external_mini_cluster.cc:1428] Setting key 5507c1d9839fa3db3b2098c972a2c5db
I20260808 07:08:27.611716 20453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Bootstrap starting.
I20260808 07:08:27.612387 20453 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:27.612708 20453 log.cc:824] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:27.613504 20453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: No bootstrap required, opened a new log
I20260808 07:08:27.615748 20453 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } }
I20260808 07:08:27.615909 20453 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:27.615947 20453 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75048b4ce01c4a99a22c3ca214e60c7e, State: Initialized, Role: FOLLOWER
I20260808 07:08:27.616093 20453 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } }
I20260808 07:08:27.616175 20453 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:08:27.616209 20453 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:08:27.616255 20453 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:27.616923 20453 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } }
I20260808 07:08:27.617059 20453 leader_election.cc:302] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75048b4ce01c4a99a22c3ca214e60c7e; no voters:
Aug 08 07:08:27 dist-test-slave-rmhg krb5kdc[20336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172907, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:27.617266 20453 leader_election.cc:288] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:08:27.617317 20461 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:08:27.617496 20461 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 1 LEADER]: Becoming Leader. State: Replica: 75048b4ce01c4a99a22c3ca214e60c7e, State: Running, Role: LEADER
I20260808 07:08:27.617570 20453 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:08:27.617637 20461 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } }
I20260808 07:08:27.618106 20462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } } }
I20260808 07:08:27.618201 20462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:27.618448 20463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75048b4ce01c4a99a22c3ca214e60c7e. Latest consensus state: current_term: 1 leader_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } } }
I20260808 07:08:27.618512 20463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:27.618872 20475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:08:27.619436 20475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:08:27.621610 20475 catalog_manager.cc:1347] Generated new cluster ID: 37d58589e6614805b73bbb9b15932860
I20260808 07:08:27.621670 20475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:08:27.625497 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:27.610498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34298 (local address 127.29.82.126:34571)
0808 07:08:27.610694 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:27.610705 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:27.610739 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:08:27.611398 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:27.611408 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:27.611492 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:27.611646 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:27.612253 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:27.613591 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:27.614383 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:27.615046 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:27.615176 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:27.617880 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:27.617885 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:27.617885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:27.617898 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:27.619972 (+ 2074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:27.620382 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:27.620386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:27.620386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:27.620494 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:27.620694 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:27.620695 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:27.620696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:27.621030 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:27.621237 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:27.621376 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 07:08:27.625309 (+ 3933us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":89,"threads_started":1}
I20260808 07:08:27.660835 20475 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:08:27.661513 20475 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:08:27.669795 20475 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Generated new TSK 0
I20260808 07:08:27.670024 20475 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:08:27.710512 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:34571
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:27.811846 20492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:27.812088 20492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:27.812111 20492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:27.813287 20492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:27.813321 20492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:27.813347 20492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:08:27.814814 20492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:34571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:27.815033 20492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:27.815232 20492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:27.820307 20501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:27.820364 20498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:27.820327 20499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:27.820626 20492 server_base.cc:1034] running on GCE node
I20260808 07:08:27.820844 20492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:27.821105 20492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:27.822299 20492 hybrid_clock.cc:648] HybridClock initialized: now 1786172907822279 us; error 35 us; skew 500 ppm
Aug 08 07:08:27 dist-test-slave-rmhg krb5kdc[20336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172907, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:27.824836 20492 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:08:27.825362 20492 webserver.cc:460] Webserver started at http://127.29.82.65:36067/ using document root <none> and password file <none>
I20260808 07:08:27.825587 20492 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:27.825632 20492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:27.825754 20492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:08:27.826807 20492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "c9d5af7874034b4f9220b974825c7811"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "75faf1ad54ce104349dfc2f2e258573f"
server_key_iv: "532635f510775c2e63b61d241c4b30f6"
server_key_version: "encryptionkey@0"
I20260808 07:08:27.827153 20492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "c9d5af7874034b4f9220b974825c7811"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "75faf1ad54ce104349dfc2f2e258573f"
server_key_iv: "532635f510775c2e63b61d241c4b30f6"
server_key_version: "encryptionkey@0"
I20260808 07:08:27.828408 20492 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:08:27.829087 20511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:27.829255 20492 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:08:27.829340 20492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "c9d5af7874034b4f9220b974825c7811"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "75faf1ad54ce104349dfc2f2e258573f"
server_key_iv: "532635f510775c2e63b61d241c4b30f6"
server_key_version: "encryptionkey@0"
I20260808 07:08:27.829408 20492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:27.844408 20492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:27.846771 20492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:27.846903 20492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:27.847144 20492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:27.847476 20492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:27.847545 20492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:27.847572 20492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:27.847584 20492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:27.853355 20492 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:42895
I20260808 07:08:27.853458 20671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:42895 every 8 connection(s)
I20260808 07:08:27.853772 20492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:08:27.857869 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 20492
I20260808 07:08:27.857981 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:08:27.858196 30025 external_mini_cluster.cc:1428] Setting key 5fd0db877ee43a6963f5e8d8c8727d15
Aug 08 07:08:27 dist-test-slave-rmhg krb5kdc[20336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172907, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:27.863891 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:27.854501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:52719 (local address 127.29.82.126:34571)
0808 07:08:27.854548 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:27.854549 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:27.854788 (+ 239us) server_negotiation.cc:407] Connection header received
0808 07:08:27.855301 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:27.855303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:27.855316 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:27.855374 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:27.856520 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:27.857054 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:27.858110 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:27.858423 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:27.858505 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:27.860913 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:27.860915 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:27.860915 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:27.860924 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:27.862269 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:27.862763 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:27.862765 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:27.862765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:27.862829 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:27.863164 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:27.863166 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:27.863166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:27.863304 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:27.863390 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:27.863680 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 07:08:27.863794 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:08:27.864084 20674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:27.854462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:52719)
0808 07:08:27.854655 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:27.854701 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:27.855202 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:27.855456 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:27.855460 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:27.856037 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:27.856399 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:27.856405 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:27.857165 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:27.857167 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:27.858007 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:27.858010 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:27.858515 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:27.858516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:27.858693 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:27.859308 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:27.859321 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:27.860812 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:27.862355 (+ 1543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:27.862364 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:27.862367 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:27.862672 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:27.862895 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:27.862896 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:27.862896 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:27.863057 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:27.863400 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:27.863408 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:27.863547 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 07:08:27.863649 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 07:08:27.863827 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":100,"threads_started":1}
I20260808 07:08:27.864660 20672 heartbeater.cc:347] Connected to a master server at 127.29.82.126:34571
I20260808 07:08:27.864753 20672 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:27.864934 20672 heartbeater.cc:511] Master 127.29.82.126:34571 requested a full tablet report, sending...
I20260808 07:08:27.865556 20398 ts_manager.cc:194] Registered new tserver with Master: c9d5af7874034b4f9220b974825c7811 (127.29.82.65:42895)
I20260808 07:08:27.866503 20398 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:52719
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:08:27.886114 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:34571
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:27.970167 20677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:27.970395 20677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:27.970431 20677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:27.971633 20677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:27.971678 20677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:27.971714 20677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:08:27.973237 20677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:34571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:27.973496 20677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:27.973726 20677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:27.978698 20684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:27.978853 20677 server_base.cc:1034] running on GCE node
W20260808 07:08:27.978747 20687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:27.978703 20685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:27.979156 20677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:27.979380 20677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:27.980520 20677 hybrid_clock.cc:648] HybridClock initialized: now 1786172907980501 us; error 39 us; skew 500 ppm
Aug 08 07:08:27 dist-test-slave-rmhg krb5kdc[20336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172907, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:27.983008 20677 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:08:27.983485 20677 webserver.cc:460] Webserver started at http://127.29.82.66:41319/ using document root <none> and password file <none>
I20260808 07:08:27.983722 20677 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:27.983773 20677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:27.983902 20677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:08:27.984982 20677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "ffedfceb407c4a1f80ce808546b03a34"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "4476fc3d7f8086419573c11a4eb61282"
server_key_iv: "442bc847f448c73529fa1ac271cf9dc2"
server_key_version: "encryptionkey@0"
I20260808 07:08:27.985347 20677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "ffedfceb407c4a1f80ce808546b03a34"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "4476fc3d7f8086419573c11a4eb61282"
server_key_iv: "442bc847f448c73529fa1ac271cf9dc2"
server_key_version: "encryptionkey@0"
I20260808 07:08:27.986630 20677 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:08:27.987344 20695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:27.987515 20677 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:08:27.987617 20677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "ffedfceb407c4a1f80ce808546b03a34"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "4476fc3d7f8086419573c11a4eb61282"
server_key_iv: "442bc847f448c73529fa1ac271cf9dc2"
server_key_version: "encryptionkey@0"
I20260808 07:08:27.987677 20677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:28.027318 20677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:28.029479 20677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:28.029640 20677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:28.029887 20677 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:28.030207 20677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:28.030243 20677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:28.030273 20677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:28.030297 20677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:28.036046 20677 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:45501
I20260808 07:08:28.036113 20848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:45501 every 8 connection(s)
I20260808 07:08:28.036433 20677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:08:28.042683 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 20677
I20260808 07:08:28.042797 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:08:28.042977 30025 external_mini_cluster.cc:1428] Setting key 6e5cd61755aaac6bbf59eb30649c38a8
Aug 08 07:08:28 dist-test-slave-rmhg krb5kdc[20336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172907, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:28.046641 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.037208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:52169 (local address 127.29.82.126:34571)
0808 07:08:28.037266 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:28.037268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:28.037479 (+ 211us) server_negotiation.cc:407] Connection header received
0808 07:08:28.038029 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:28.038031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:28.038046 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:28.038106 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:28.039258 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.039764 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.040822 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.041035 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.041095 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.043473 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:28.043475 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:28.043475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:28.043482 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:28.045118 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:28.045696 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:28.045697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:28.045698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:28.045760 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:28.045990 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:28.045991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:28.045992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:28.046108 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:28.046168 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:28.046447 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 07:08:28.046546 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:08:28.046810 20851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.037177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:52169)
0808 07:08:28.037348 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:28.037389 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:28.037914 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:28.038185 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:28.038188 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:28.038894 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:28.039124 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:28.039130 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.039864 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.039865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:28.040724 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:28.040726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.041115 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.041116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:28.041275 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.041813 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:28.041823 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:28.043384 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:28.045282 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:28.045290 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:28.045293 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:28.045594 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:28.045819 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:28.045819 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:28.045819 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:28.045922 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:28.046173 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:28.046181 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:28.046319 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 07:08:28.046414 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 07:08:28.046589 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":92,"threads_started":1}
I20260808 07:08:28.047287 20849 heartbeater.cc:347] Connected to a master server at 127.29.82.126:34571
I20260808 07:08:28.047380 20849 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:28.047607 20849 heartbeater.cc:511] Master 127.29.82.126:34571 requested a full tablet report, sending...
I20260808 07:08:28.048017 20398 ts_manager.cc:194] Registered new tserver with Master: ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501)
I20260808 07:08:28.048539 20398 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:52169
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:08:28.070101 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:34571
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:28.155458 20855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:28.155669 20855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:28.155692 20855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:28.156817 20855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:28.156852 20855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:28.156877 20855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:08:28.158370 20855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:34571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:28.158581 20855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:28.158771 20855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:28.163754 20864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:28.163754 20862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:28.163779 20855 server_base.cc:1034] running on GCE node
W20260808 07:08:28.163782 20861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:28.164296 20855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:28.164582 20855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:28.165757 20855 hybrid_clock.cc:648] HybridClock initialized: now 1786172908165734 us; error 36 us; skew 500 ppm
Aug 08 07:08:28 dist-test-slave-rmhg krb5kdc[20336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172908, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:28.168292 20855 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:08:28.168780 20855 webserver.cc:460] Webserver started at http://127.29.82.67:46219/ using document root <none> and password file <none>
I20260808 07:08:28.169021 20855 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:28.169073 20855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:28.169242 20855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:08:28.170420 20855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "28dd78d3f30f4970b109c1b4d649c64e"
format_stamp: "Formatted at 2026-08-08 07:08:28 on dist-test-slave-rmhg"
server_key: "04752910b77684218788f7d06d93b4db"
server_key_iv: "8b2815b909efcef2844bee3f907cf7ea"
server_key_version: "encryptionkey@0"
I20260808 07:08:28.170732 20855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "28dd78d3f30f4970b109c1b4d649c64e"
format_stamp: "Formatted at 2026-08-08 07:08:28 on dist-test-slave-rmhg"
server_key: "04752910b77684218788f7d06d93b4db"
server_key_iv: "8b2815b909efcef2844bee3f907cf7ea"
server_key_version: "encryptionkey@0"
I20260808 07:08:28.172046 20855 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:08:28.172752 20873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:28.172912 20855 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:08:28.173012 20855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "28dd78d3f30f4970b109c1b4d649c64e"
format_stamp: "Formatted at 2026-08-08 07:08:28 on dist-test-slave-rmhg"
server_key: "04752910b77684218788f7d06d93b4db"
server_key_iv: "8b2815b909efcef2844bee3f907cf7ea"
server_key_version: "encryptionkey@0"
I20260808 07:08:28.173085 20855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:28.188796 20855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:28.191128 20855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:28.191257 20855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:28.191524 20855 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:28.191865 20855 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:28.191900 20855 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:28.191933 20855 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:28.191955 20855 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:28.197781 20855 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:43121
I20260808 07:08:28.197839 21034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:43121 every 8 connection(s)
I20260808 07:08:28.198173 20855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:08:28 dist-test-slave-rmhg krb5kdc[20336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172908, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:28.206149 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 20855
I20260808 07:08:28.206238 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:08:28.206398 30025 external_mini_cluster.cc:1428] Setting key 2e5f033a9d5cae0bada2ddfa47b99ef1
I20260808 07:08:28.207429 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.198896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:46163 (local address 127.29.82.126:34571)
0808 07:08:28.198945 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:28.198946 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:28.199151 (+ 205us) server_negotiation.cc:407] Connection header received
0808 07:08:28.199637 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:28.199638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:28.199649 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:28.199688 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:28.200658 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.201190 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.202167 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.202353 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.202403 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.204554 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:28.204556 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:28.204556 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:28.204566 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:28.205916 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:28.206353 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:28.206354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:28.206355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:28.206420 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:28.206655 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:28.206656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:28.206657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:28.206811 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:28.206871 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:28.207247 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 07:08:28.207336 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:08:28.207633 21041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.198863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:46163)
0808 07:08:28.199021 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:28.199059 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:28.199542 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:28.199747 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:28.199751 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:28.200368 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:28.200583 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:28.200588 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.201270 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.201271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:28.202092 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:28.202104 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.202415 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.202415 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:28.202519 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.202990 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:28.202999 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:28.204443 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:28.205997 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:28.206005 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:28.206007 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:28.206273 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:28.206479 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:28.206480 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:28.206481 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:28.206592 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:28.206872 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:28.206881 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:28.207058 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 07:08:28.207219 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 07:08:28.207395 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":88,"threads_started":1}
I20260808 07:08:28.208096 21035 heartbeater.cc:347] Connected to a master server at 127.29.82.126:34571
I20260808 07:08:28.208197 21035 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:28.208364 21035 heartbeater.cc:511] Master 127.29.82.126:34571 requested a full tablet report, sending...
I20260808 07:08:28.208751 20398 ts_manager.cc:194] Registered new tserver with Master: 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121)
I20260808 07:08:28.209118 20398 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:46163
I20260808 07:08:28.218108 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:08:28.225322 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.219515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34304 (local address 127.29.82.126:34571)
0808 07:08:28.219591 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:28.219594 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:28.219765 (+ 171us) server_negotiation.cc:407] Connection header received
0808 07:08:28.219812 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:28.219813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:28.219825 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:28.219887 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:28.220647 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.221250 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.221951 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.222134 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.222179 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.223243 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:28.223245 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:28.223245 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:28.223252 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:28.224339 (+ 1087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:28.224651 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:28.224651 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:28.224652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:28.224703 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:28.224819 (+ 116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:28.224819 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:28.224819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:28.224966 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:28.225042 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:28.225136 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 07:08:28.225249 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 07:08:28.226872 20398 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34304:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:08:28.228458 20398 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:08:28.235322 21056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.230929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:45501 (local address 127.0.0.1:35012)
0808 07:08:28.231131 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:28.231178 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:28.231249 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:28.231440 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:28.231442 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:28.231444 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:28.231570 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:28.231572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.232860 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.232861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:28.234156 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:28.234159 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.235058 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.235059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:28.235123 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.235129 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:08:28.235176 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:08:28.235225 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":38,"thread_start_us":63,"threads_started":1}
I20260808 07:08:28.235339 21059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.231062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52012 (local address 127.29.82.67:43121)
0808 07:08:28.231958 (+ 896us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:28.231962 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:28.231971 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:08:28.232005 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:28.232007 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:28.232020 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:28.232105 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:28.232228 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.233341 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.234504 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.235026 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.235096 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.235156 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:28.235224 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 07:08:28.235263 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":857,"thread_start_us":81,"threads_started":1}
I20260808 07:08:28.235322 21054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.230941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:43121 (local address 127.0.0.1:52012)
0808 07:08:28.231226 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:28.231236 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:28.231277 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:28.232112 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:28.232113 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:28.232115 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:28.232156 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:28.232157 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.233462 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.233464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:28.234433 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:28.234435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.235095 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.235095 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:28.235146 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.235149 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:08:28.235208 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 07:08:28.235242 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":2,"thread_start_us":98,"threads_started":1}
I20260808 07:08:28.235383 21061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.231362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54934 (local address 127.29.82.65:42895)
0808 07:08:28.231551 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:28.231555 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:28.231695 (+ 140us) server_negotiation.cc:407] Connection header received
0808 07:08:28.231737 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:28.231739 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:28.231753 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:28.231824 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:28.232001 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.232847 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.234127 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.234873 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.234958 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.235021 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:28.235273 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 07:08:28.235316 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":93,"threads_started":1}
I20260808 07:08:28.235658 21057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.231039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35012 (local address 127.29.82.66:45501)
0808 07:08:28.231261 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:28.231267 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:28.231280 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:08:28.231327 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:28.231329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:28.231345 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:28.231443 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:28.231637 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.232752 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.234236 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.234901 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.234958 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.235021 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:28.235550 (+ 529us) server_negotiation.cc:299] Negotiation successful
0808 07:08:28.235598 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":99,"threads_started":1}
I20260808 07:08:28.235984 21060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.231156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:42895 (local address 127.0.0.1:54934)
0808 07:08:28.231572 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:28.231583 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:28.231639 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:28.231859 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:28.231860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:28.231883 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:28.231933 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:28.231934 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.232951 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.232952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:28.234050 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:28.234053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.234967 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.234968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:28.235045 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.235061 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 07:08:28.235138 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 07:08:28.235201 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":70,"threads_started":1}
I20260808 07:08:28.236344 20756 tablet_service.cc:1467] Processing CreateTablet for tablet c9174c9063a14d03849a73d4eb639291 (DEFAULT_TABLE table=test-table [id=d767913987974b4c9e7e8d995ff9bb3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:28.236693 20756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9174c9063a14d03849a73d4eb639291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:28.236629 20578 tablet_service.cc:1467] Processing CreateTablet for tablet c9174c9063a14d03849a73d4eb639291 (DEFAULT_TABLE table=test-table [id=d767913987974b4c9e7e8d995ff9bb3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:28.236965 20578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9174c9063a14d03849a73d4eb639291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:28.237612 20942 tablet_service.cc:1467] Processing CreateTablet for tablet c9174c9063a14d03849a73d4eb639291 (DEFAULT_TABLE table=test-table [id=d767913987974b4c9e7e8d995ff9bb3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:28.237941 20942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9174c9063a14d03849a73d4eb639291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:28.239533 21062 tablet_bootstrap.cc:492] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34: Bootstrap starting.
I20260808 07:08:28.240186 21062 tablet_bootstrap.cc:654] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:28.240269 21063 tablet_bootstrap.cc:492] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Bootstrap starting.
I20260808 07:08:28.240857 21062 log.cc:824] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:28.240950 21063 tablet_bootstrap.cc:654] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:28.241067 21064 tablet_bootstrap.cc:492] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e: Bootstrap starting.
I20260808 07:08:28.241492 21063 log.cc:824] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:28.241717 21064 tablet_bootstrap.cc:654] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:28.242261 21064 log.cc:824] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:28.242306 21063 tablet_bootstrap.cc:492] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: No bootstrap required, opened a new log
I20260808 07:08:28.242363 21063 ts_tablet_manager.cc:1397] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:08:28.243016 21064 tablet_bootstrap.cc:492] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e: No bootstrap required, opened a new log
I20260808 07:08:28.243089 21064 ts_tablet_manager.cc:1397] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:08:28.244297 21063 raft_consensus.cc:348] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } } peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } }
I20260808 07:08:28.244506 21063 raft_consensus.cc:374] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:28.244553 21063 raft_consensus.cc:729] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d5af7874034b4f9220b974825c7811, State: Initialized, Role: FOLLOWER
I20260808 07:08:28.244683 21063 consensus_queue.cc:260] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } } peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } }
I20260808 07:08:28.244976 21063 ts_tablet_manager.cc:1428] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 07:08:28.245033 20672 heartbeater.cc:503] Master 127.29.82.126:34571 was elected leader, sending a full tablet report...
I20260808 07:08:28.245015 21064 raft_consensus.cc:348] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } } peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } }
I20260808 07:08:28.245261 21064 raft_consensus.cc:374] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:28.245301 21064 raft_consensus.cc:729] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28dd78d3f30f4970b109c1b4d649c64e, State: Initialized, Role: FOLLOWER
I20260808 07:08:28.245424 21064 consensus_queue.cc:260] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } } peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } }
I20260808 07:08:28.245519 21062 tablet_bootstrap.cc:492] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34: No bootstrap required, opened a new log
I20260808 07:08:28.245599 21062 ts_tablet_manager.cc:1397] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260808 07:08:28.245703 21064 ts_tablet_manager.cc:1428] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:08:28.245731 21035 heartbeater.cc:503] Master 127.29.82.126:34571 was elected leader, sending a full tablet report...
I20260808 07:08:28.247295 21062 raft_consensus.cc:348] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } } peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } }
I20260808 07:08:28.247421 21062 raft_consensus.cc:374] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:28.247438 21062 raft_consensus.cc:729] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffedfceb407c4a1f80ce808546b03a34, State: Initialized, Role: FOLLOWER
I20260808 07:08:28.247517 21062 consensus_queue.cc:260] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } } peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } }
I20260808 07:08:28.247722 21062 ts_tablet_manager.cc:1428] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:08:28.247763 20849 heartbeater.cc:503] Master 127.29.82.126:34571 was elected leader, sending a full tablet report...
W20260808 07:08:28.287096 20850 tablet.cc:2369] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:08:28.354472 20673 tablet.cc:2369] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:08:28.391013 21068 raft_consensus.cc:482] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:08:28.391160 21068 raft_consensus.cc:504] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } } peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } }
I20260808 07:08:28.391533 21068 leader_election.cc:288] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501), 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121)
I20260808 07:08:28.394501 21059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.391862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:53463 (local address 127.29.82.67:43121)
0808 07:08:28.391902 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:28.391904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:28.391970 (+ 66us) server_negotiation.cc:407] Connection header received
0808 07:08:28.392022 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:28.392023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:28.392033 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:28.392074 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:28.392240 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.392726 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.393793 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.394175 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.394241 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.394250 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:28.394391 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 07:08:28.394430 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:08:28.394496 21057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.391840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:53875 (local address 127.29.82.66:45501)
0808 07:08:28.391889 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:28.391891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:28.391935 (+ 44us) server_negotiation.cc:407] Connection header received
0808 07:08:28.392034 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:28.392035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:28.392045 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:28.392099 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:28.392263 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.392716 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.393803 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.394165 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.394224 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.394234 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:28.394384 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 07:08:28.394418 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:08:28.394527 21072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.391726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:45501 (local address 127.29.82.65:53875)
0808 07:08:28.391869 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:28.391881 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:28.391952 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:28.392111 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:28.392112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:28.392114 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:28.392197 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:28.392199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.392792 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.392793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:28.393712 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:28.393714 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.394242 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.394244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:28.394316 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.394320 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:08:28.394364 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:08:28.394414 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":42,"thread_start_us":85,"threads_started":1}
I20260808 07:08:28.394538 21073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.391726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:43121 (local address 127.29.82.65:53463)
0808 07:08:28.391879 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:28.391889 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:28.391967 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:28.392078 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:28.392079 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:28.392083 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:28.392174 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:28.392181 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.392802 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.392803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:28.393699 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:28.393701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.394249 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.394250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:28.394322 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.394326 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:08:28.394373 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:08:28.394419 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":2,"thread_start_us":66,"threads_started":1}
I20260808 07:08:28.394827 20781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9174c9063a14d03849a73d4eb639291" candidate_uuid: "c9d5af7874034b4f9220b974825c7811" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffedfceb407c4a1f80ce808546b03a34" is_pre_election: true
I20260808 07:08:28.394981 20781 raft_consensus.cc:2454] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d5af7874034b4f9220b974825c7811 in term 0.
I20260808 07:08:28.395073 20973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9174c9063a14d03849a73d4eb639291" candidate_uuid: "c9d5af7874034b4f9220b974825c7811" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28dd78d3f30f4970b109c1b4d649c64e" is_pre_election: true
I20260808 07:08:28.395210 20973 raft_consensus.cc:2454] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d5af7874034b4f9220b974825c7811 in term 0.
I20260808 07:08:28.395246 20513 leader_election.cc:302] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d5af7874034b4f9220b974825c7811, ffedfceb407c4a1f80ce808546b03a34; no voters:
I20260808 07:08:28.395394 21068 raft_consensus.cc:2781] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:08:28.395438 21068 raft_consensus.cc:482] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:08:28.395462 21068 raft_consensus.cc:3037] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:28.396178 21068 raft_consensus.cc:504] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } } peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } }
I20260808 07:08:28.396313 21068 leader_election.cc:288] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 1 election: Requested vote from peers ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501), 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121)
I20260808 07:08:28.396505 20973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9174c9063a14d03849a73d4eb639291" candidate_uuid: "c9d5af7874034b4f9220b974825c7811" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28dd78d3f30f4970b109c1b4d649c64e"
I20260808 07:08:28.396507 20781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9174c9063a14d03849a73d4eb639291" candidate_uuid: "c9d5af7874034b4f9220b974825c7811" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffedfceb407c4a1f80ce808546b03a34"
I20260808 07:08:28.396589 20973 raft_consensus.cc:3037] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:28.396589 20781 raft_consensus.cc:3037] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:28.397504 20973 raft_consensus.cc:2454] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d5af7874034b4f9220b974825c7811 in term 1.
I20260808 07:08:28.397505 20781 raft_consensus.cc:2454] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d5af7874034b4f9220b974825c7811 in term 1.
I20260808 07:08:28.397681 20516 leader_election.cc:302] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28dd78d3f30f4970b109c1b4d649c64e, c9d5af7874034b4f9220b974825c7811; no voters:
I20260808 07:08:28.397774 21068 raft_consensus.cc:2781] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:08:28.397928 21068 raft_consensus.cc:686] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 1 LEADER]: Becoming Leader. State: Replica: c9d5af7874034b4f9220b974825c7811, State: Running, Role: LEADER
I20260808 07:08:28.398020 21068 consensus_queue.cc:237] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } } peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } }
I20260808 07:08:28.398873 20398 catalog_manager.cc:5495] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9d5af7874034b4f9220b974825c7811 (127.29.82.65). New cstate: current_term: 1 leader_uuid: "c9d5af7874034b4f9220b974825c7811" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } health_report { overall_health: UNKNOWN } } }
I20260808 07:08:28.415987 21061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.413749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54940 (local address 127.29.82.65:42895)
0808 07:08:28.413814 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:28.413816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:28.413823 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:08:28.413859 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:28.413860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:28.413879 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:28.413937 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:08:28.414050 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.414512 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.415297 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:28.415535 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:28.415606 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:28.415730 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:08:28.415836 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:08:28.415894 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:28.415907 (+ 13us) server_negotiation.cc:299] Negotiation successful
0808 07:08:28.415926 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:08:28.417961 20973 raft_consensus.cc:1261] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e [term 1 FOLLOWER]: Refusing update from remote peer c9d5af7874034b4f9220b974825c7811: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:08:28.417961 20781 raft_consensus.cc:1261] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34 [term 1 FOLLOWER]: Refusing update from remote peer c9d5af7874034b4f9220b974825c7811: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:08:28.418349 21076 consensus_queue.cc:1035] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:08:28.418503 21068 consensus_queue.cc:1035] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:08:28.421087 21080 mvcc.cc:205] Tried to move back new op lower bound from 7316164232876998656 to 7316164232798969856. Current Snapshot: MvccSnapshot[applied={T|T < 7316164232876998656}]
I20260808 07:08:28.423431 20394 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34304:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:08:28.423542 20394 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34304:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:08:28.424343 20394 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Sending DeleteTablet for 3 replicas of tablet c9174c9063a14d03849a73d4eb639291
I20260808 07:08:28.424706 20756 tablet_service.cc:1514] Processing DeleteTablet for tablet c9174c9063a14d03849a73d4eb639291 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:28 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:35012
I20260808 07:08:28.424711 20578 tablet_service.cc:1514] Processing DeleteTablet for tablet c9174c9063a14d03849a73d4eb639291 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:28 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:54934
I20260808 07:08:28.424737 20942 tablet_service.cc:1514] Processing DeleteTablet for tablet c9174c9063a14d03849a73d4eb639291 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:28 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:52012
I20260808 07:08:28.425024 21092 tablet_replica.cc:330] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e: stopping tablet replica
I20260808 07:08:28.425057 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 20492
I20260808 07:08:28.427593 21091 tablet_replica.cc:330] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34: stopping tablet replica
I20260808 07:08:28.427707 21091 raft_consensus.cc:2229] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:08:28.427811 21091 raft_consensus.cc:2258] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:28.425130 21092 raft_consensus.cc:2229] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:08:28.428364 21091 ts_tablet_manager.cc:1905] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:08:28.430356 21091 ts_tablet_manager.cc:1918] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:08:28.430486 21091 log.cc:1196] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/c9174c9063a14d03849a73d4eb639291
I20260808 07:08:28.430860 21091 ts_tablet_manager.cc:1939] T c9174c9063a14d03849a73d4eb639291 P ffedfceb407c4a1f80ce808546b03a34: Deleting consensus metadata
I20260808 07:08:28.431425 20375 catalog_manager.cc:4841] TS ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501): tablet c9174c9063a14d03849a73d4eb639291 (table test-table [id=d767913987974b4c9e7e8d995ff9bb3e]) successfully deleted
I20260808 07:08:28.428002 21092 raft_consensus.cc:2258] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:28.433305 21092 ts_tablet_manager.cc:1905] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:08:28.434787 21092 ts_tablet_manager.cc:1918] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:08:28.434850 21092 log.cc:1196] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/c9174c9063a14d03849a73d4eb639291
I20260808 07:08:28.435065 21092 ts_tablet_manager.cc:1939] T c9174c9063a14d03849a73d4eb639291 P 28dd78d3f30f4970b109c1b4d649c64e: Deleting consensus metadata
I20260808 07:08:28.435488 20381 catalog_manager.cc:4841] TS 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121): tablet c9174c9063a14d03849a73d4eb639291 (table test-table [id=d767913987974b4c9e7e8d995ff9bb3e]) successfully deleted
W20260808 07:08:28.437343 20375 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:42895 (error 108)
I20260808 07:08:28.437424 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 20677
I20260808 07:08:28.439869 21056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:28.439739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:42895 (local address 127.0.0.1:54944)
0808 07:08:28.439791 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:28.439835 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 07:08:28.440050 20375 catalog_manager.cc:4584] TS c9d5af7874034b4f9220b974825c7811 (127.29.82.65:42895): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c9174c9063a14d03849a73d4eb639291: Network error: Client connection negotiation failed: client connection to 127.29.82.65:42895: connect: Connection refused (error 111)
I20260808 07:08:28.446202 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 20855
I20260808 07:08:28.462556 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 20357
I20260808 07:08:48.472679 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:34571
--webserver_interface=127.29.82.126
--webserver_port=38741
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:34571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:08:48.558315 21096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:48.558552 21096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:48.558574 21096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:48.559748 21096 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 07:08:48.559787 21096 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 07:08:48.559798 21096 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 07:08:48.559808 21096 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:08:48.559819 21096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:48.559830 21096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:48.559841 21096 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:08:48.559852 21096 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:08:48.561386 21096 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:34571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:34571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=38741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:48.561607 21096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:48.561793 21096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:48.571035 21103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:48.571106 21104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:48.571035 21107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:48.571122 21096 server_base.cc:1034] running on GCE node
I20260808 07:08:48.571535 21096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:48.571872 21096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:48.573033 21096 hybrid_clock.cc:648] HybridClock initialized: now 1786172928573012 us; error 34 us; skew 500 ppm
Aug 08 07:08:48 dist-test-slave-rmhg krb5kdc[20336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172928, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:48.575634 21096 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:08:48.576135 21096 webserver.cc:460] Webserver started at http://127.29.82.126:38741/ using document root <none> and password file <none>
I20260808 07:08:48.576370 21096 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:48.576436 21096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:48.577911 21096 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:08:48.578673 21117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:48.578866 21096 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:48.578964 21096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "75048b4ce01c4a99a22c3ca214e60c7e"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "7f2debf3a9b589f1110ab2e35888eff1"
server_key_iv: "3a40c739402d8cc5c4147a33d3401e5f"
server_key_version: "encryptionkey@0"
I20260808 07:08:48.579393 21096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:48.594298 21096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:48.596374 21096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:48.596536 21096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:48.600713 21096 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:34571
I20260808 07:08:48.600757 21189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:34571 every 8 connection(s)
I20260808 07:08:48.601140 21096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:08:48.602698 21190 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:08:48.603340 21190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Bootstrap starting.
I20260808 07:08:48.609396 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 21096
I20260808 07:08:48.609714 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:42895
--local_ip_for_outbound_sockets=127.29.82.65
--tserver_master_addrs=127.29.82.126:34571
--webserver_port=36067
--webserver_interface=127.29.82.65
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:08:48.611650 21190 log.cc:824] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:48.613873 21190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:08:48.614166 21190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Bootstrap complete.
I20260808 07:08:48.616318 21190 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } }
I20260808 07:08:48.616559 21190 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75048b4ce01c4a99a22c3ca214e60c7e, State: Initialized, Role: FOLLOWER
I20260808 07:08:48.616719 21190 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } }
I20260808 07:08:48.616799 21190 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:08:48.616856 21190 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:08:48.616906 21190 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:08:48.617972 21190 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } }
I20260808 07:08:48.618074 21190 leader_election.cc:302] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75048b4ce01c4a99a22c3ca214e60c7e; no voters:
I20260808 07:08:48.618247 21190 leader_election.cc:288] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 07:08:48.618300 21195 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:08:48.618455 21195 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 2 LEADER]: Becoming Leader. State: Replica: 75048b4ce01c4a99a22c3ca214e60c7e, State: Running, Role: LEADER
I20260808 07:08:48.618607 21190 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:08:48.618681 21195 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } }
I20260808 07:08:48.619055 21195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75048b4ce01c4a99a22c3ca214e60c7e. Latest consensus state: current_term: 2 leader_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } } }
I20260808 07:08:48.619203 21195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:48.619692 21205 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:08:48.619995 21196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } } }
I20260808 07:08:48.620102 21196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: This master's current role is: LEADER
I20260808 07:08:48.620574 21205 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:08:48.620678 21205 catalog_manager.cc:1259] Loaded cluster ID: 37d58589e6614805b73bbb9b15932860
I20260808 07:08:48.620764 21205 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:08:48.621721 21205 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:08:48.621901 21205 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Loaded TSK: 0
I20260808 07:08:48.632856 21205 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Generated new TSK 1
I20260808 07:08:48.632970 21205 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:08:48.710019 21193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:48.710232 21193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:48.710254 21193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:48.711403 21193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:48.711447 21193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:48.711473 21193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:08:48.712925 21193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:42895
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=36067
--tserver_master_addrs=127.29.82.126:34571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:48.713171 21193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:48.713404 21193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:48.718331 21229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:48.718420 21234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:48.718324 21230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:48.718641 21193 server_base.cc:1034] running on GCE node
I20260808 07:08:48.718849 21193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:48.719075 21193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:48.720212 21193 hybrid_clock.cc:648] HybridClock initialized: now 1786172928720197 us; error 32 us; skew 500 ppm
Aug 08 07:08:48 dist-test-slave-rmhg krb5kdc[20336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172928, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:48.722831 21193 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:08:48.723379 21193 webserver.cc:460] Webserver started at http://127.29.82.65:36067/ using document root <none> and password file <none>
I20260808 07:08:48.723627 21193 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:48.723708 21193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:48.725528 21193 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:08:48.726307 21245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:48.726482 21193 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:08:48.726572 21193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "c9d5af7874034b4f9220b974825c7811"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "75faf1ad54ce104349dfc2f2e258573f"
server_key_iv: "532635f510775c2e63b61d241c4b30f6"
server_key_version: "encryptionkey@0"
I20260808 07:08:48.726919 21193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:48.743712 21193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:48.745990 21193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:48.746125 21193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:48.746369 21193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:48.746841 21254 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 07:08:48.748809 21193 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 07:08:48.748876 21193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 07:08:48.748939 21193 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 07:08:48.749670 21193 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 07:08:48.749706 21193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 07:08:48.749789 21254 tablet_bootstrap.cc:492] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Bootstrap starting.
I20260808 07:08:48.755903 21193 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:42895
I20260808 07:08:48.756002 21407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:42895 every 8 connection(s)
I20260808 07:08:48.756378 21193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:08:48.760919 21254 log.cc:824] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:48.764249 21254 tablet_bootstrap.cc:492] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:08:48.764577 21254 tablet_bootstrap.cc:492] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Bootstrap complete.
I20260808 07:08:48.765691 21254 ts_tablet_manager.cc:1397] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.014s
I20260808 07:08:48.766197 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 21193
I20260808 07:08:48.766494 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:45501
--local_ip_for_outbound_sockets=127.29.82.66
--tserver_master_addrs=127.29.82.126:34571
--webserver_port=41319
--webserver_interface=127.29.82.66
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:08:48.767096 21254 raft_consensus.cc:348] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } } peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } }
I20260808 07:08:48.767397 21254 raft_consensus.cc:729] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d5af7874034b4f9220b974825c7811, State: Initialized, Role: FOLLOWER
I20260808 07:08:48.767568 21254 consensus_queue.cc:260] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } } peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } }
I20260808 07:08:48.767855 21254 ts_tablet_manager.cc:1428] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
Aug 08 07:08:48 dist-test-slave-rmhg krb5kdc[20336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172928, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:48.774093 21414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:48.762205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:47147 (local address 127.29.82.126:34571)
0808 07:08:48.762431 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:48.762441 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:48.762589 (+ 148us) server_negotiation.cc:407] Connection header received
0808 07:08:48.763335 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:48.763343 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:48.763415 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:48.763628 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:48.764577 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:48.765951 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:48.767621 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:48.768224 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:48.768327 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:48.770812 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:48.770816 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:48.770817 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:48.770829 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:48.772354 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:48.772773 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:48.772776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:48.772777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:48.772870 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:48.773109 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:48.773110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:48.773110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:48.773389 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:48.773466 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:48.773755 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 07:08:48.773883 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":90,"threads_started":1}
I20260808 07:08:48.774106 21413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:48.762125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:47147)
0808 07:08:48.762414 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:48.762463 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:48.763102 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:48.763655 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:48.763659 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:48.764140 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:48.764441 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:48.764448 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:48.766103 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:48.766104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:48.767527 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:48.767530 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:48.768324 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:48.768325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:48.768467 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:48.769065 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:48.769076 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:48.770698 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:48.772451 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:48.772458 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:48.772461 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:48.772689 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:48.772934 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:48.772935 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:48.772935 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:48.773052 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:48.773455 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:48.773462 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:48.773602 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 07:08:48.773694 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 07:08:48.773883 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":76,"threads_started":1}
I20260808 07:08:48.774786 21408 heartbeater.cc:347] Connected to a master server at 127.29.82.126:34571
I20260808 07:08:48.774881 21408 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:48.775058 21408 heartbeater.cc:511] Master 127.29.82.126:34571 requested a full tablet report, sending...
I20260808 07:08:48.775774 21141 ts_manager.cc:194] Registered new tserver with Master: c9d5af7874034b4f9220b974825c7811 (127.29.82.65:42895)
I20260808 07:08:48.776810 21141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:47147
I20260808 07:08:48.777797 21408 heartbeater.cc:503] Master 127.29.82.126:34571 was elected leader, sending a full tablet report...
Aug 08 07:08:48 dist-test-slave-rmhg krb5kdc[20336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172928, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for kudu/127.29.82.65@KRBTEST.COM
I20260808 07:08:48.785362 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:48.776451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51390 (local address 127.29.82.65:42895)
0808 07:08:48.776922 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:48.776927 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:48.776937 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:08:48.776972 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:48.776974 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:48.776988 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:48.777064 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:48.777600 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:48.778903 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:48.779748 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:48.780226 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:48.780297 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:48.782569 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:48.782578 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:48.782578 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:48.782585 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:48.784110 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:48.784566 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:48.784569 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:48.784569 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:48.784619 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:48.784790 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:48.784790 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:48.784791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:48.784923 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:48.784982 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:48.785183 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 07:08:48.785280 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":94,"threads_started":1}
I20260808 07:08:48.785403 21417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:48.776380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:42895 (local address 127.0.0.1:51390)
0808 07:08:48.776663 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:48.776710 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:48.776786 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:48.777080 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:48.777087 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:48.777440 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:48.777512 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:48.777515 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:48.779056 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:48.779057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:48.779671 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:48.779673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:48.780309 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:48.780310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:48.780375 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:48.780854 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:48.780860 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:48.782486 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:48.784188 (+ 1702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:48.784196 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:48.784198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:48.784494 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:48.784671 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:48.784671 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:48.784671 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:48.784740 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:48.784975 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:48.784982 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:48.785042 (+ 60us) client_negotiation.cc:769] Sending connection context
0808 07:08:48.785133 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 07:08:48.785289 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":115,"threads_started":1}
I20260808 07:08:48.785826 21314 tablet_service.cc:1514] Processing DeleteTablet for tablet c9174c9063a14d03849a73d4eb639291 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:28 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:51390
I20260808 07:08:48.786412 21419 tablet_replica.cc:330] stopping tablet replica
I20260808 07:08:48.786511 21419 raft_consensus.cc:2229] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:08:48.786607 21419 raft_consensus.cc:2258] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:48.786923 21419 ts_tablet_manager.cc:1905] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:08:48.789034 21419 ts_tablet_manager.cc:1918] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:08:48.789099 21419 log.cc:1196] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal/wals/c9174c9063a14d03849a73d4eb639291
I20260808 07:08:48.789366 21419 ts_tablet_manager.cc:1939] T c9174c9063a14d03849a73d4eb639291 P c9d5af7874034b4f9220b974825c7811: Deleting consensus metadata
I20260808 07:08:48.789914 21118 catalog_manager.cc:4841] TS c9d5af7874034b4f9220b974825c7811 (127.29.82.65:42895): tablet c9174c9063a14d03849a73d4eb639291 (table test-table [id=d767913987974b4c9e7e8d995ff9bb3e]) successfully deleted
W20260808 07:08:48.854923 21416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:48.855159 21416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:48.855185 21416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:48.856326 21416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:48.856364 21416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:48.856389 21416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:08:48.857877 21416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:45501
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=41319
--tserver_master_addrs=127.29.82.126:34571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:48.858089 21416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:48.858294 21416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:48.863349 21427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:48.863340 21425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:48.863340 21424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:48.863632 21416 server_base.cc:1034] running on GCE node
I20260808 07:08:48.863843 21416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:48.864182 21416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:48.865347 21416 hybrid_clock.cc:648] HybridClock initialized: now 1786172928865297 us; error 69 us; skew 500 ppm
Aug 08 07:08:48 dist-test-slave-rmhg krb5kdc[20336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172928, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:48.868211 21416 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:08:48.868687 21416 webserver.cc:460] Webserver started at http://127.29.82.66:41319/ using document root <none> and password file <none>
I20260808 07:08:48.868908 21416 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:48.868968 21416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:48.870541 21416 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:48.871224 21435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:48.871378 21416 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:08:48.871469 21416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "ffedfceb407c4a1f80ce808546b03a34"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "4476fc3d7f8086419573c11a4eb61282"
server_key_iv: "442bc847f448c73529fa1ac271cf9dc2"
server_key_version: "encryptionkey@0"
I20260808 07:08:48.871840 21416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:48.884397 21416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:48.886721 21416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:48.886857 21416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:48.887118 21416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:48.887436 21416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:48.887473 21416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:48.887502 21416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:48.887526 21416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:48.893327 21416 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:45501
I20260808 07:08:48.893380 21588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:45501 every 8 connection(s)
I20260808 07:08:48.893735 21416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:08:48 dist-test-slave-rmhg krb5kdc[20336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172928, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:48.903528 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 21416
I20260808 07:08:48.903879 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:43121
--local_ip_for_outbound_sockets=127.29.82.67
--tserver_master_addrs=127.29.82.126:34571
--webserver_port=46219
--webserver_interface=127.29.82.67
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:08:48.904115 21414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:48.894493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:36817 (local address 127.29.82.126:34571)
0808 07:08:48.894579 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:48.894582 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:48.894855 (+ 273us) server_negotiation.cc:407] Connection header received
0808 07:08:48.895504 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:48.895506 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:48.895522 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:48.895583 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:48.896694 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:48.897305 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:48.898404 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:48.898625 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:48.898691 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:48.901059 (+ 2368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:48.901061 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:48.901061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:48.901069 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:48.902488 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:48.902921 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:48.902923 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:48.902923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:48.902992 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:48.903243 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:48.903244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:48.903244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:48.903358 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:48.903412 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:48.903889 (+ 477us) server_negotiation.cc:299] Negotiation successful
0808 07:08:48.904006 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 07:08:48.904338 21591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:48.894503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:36817)
0808 07:08:48.894677 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:48.894719 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:48.895352 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:48.895725 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:48.895729 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:48.896345 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:48.896553 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:48.896558 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:48.897421 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:48.897423 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:48.898292 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:48.898295 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:48.898726 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:48.898727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:48.898853 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:48.899408 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:48.899417 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:48.900937 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:48.902578 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:48.902585 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:48.902588 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:48.902826 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:48.903066 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:48.903067 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:48.903068 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:48.903188 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:48.903446 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:48.903455 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:48.903699 (+ 244us) client_negotiation.cc:769] Sending connection context
0808 07:08:48.903832 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 07:08:48.904029 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":93,"threads_started":1}
I20260808 07:08:48.904901 21589 heartbeater.cc:347] Connected to a master server at 127.29.82.126:34571
I20260808 07:08:48.905006 21589 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:48.905257 21589 heartbeater.cc:511] Master 127.29.82.126:34571 requested a full tablet report, sending...
I20260808 07:08:48.905719 21141 ts_manager.cc:194] Registered new tserver with Master: ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501)
I20260808 07:08:48.906108 21141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:36817
W20260808 07:08:48.988771 21592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:08:48.989001 21592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:08:48.989034 21592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:08:48.990229 21592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:08:48.990274 21592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:08:48.990309 21592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:08:48.991760 21592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:43121
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=46219
--tserver_master_addrs=127.29.82.126:34571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:08:48.991995 21592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:08:48.992223 21592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:08:48.997001 21597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:48.997009 21598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:08:48.997009 21600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:08:48.997313 21592 server_base.cc:1034] running on GCE node
I20260808 07:08:48.997512 21592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:08:48.997750 21592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:08:48.998890 21592 hybrid_clock.cc:648] HybridClock initialized: now 1786172928998877 us; error 29 us; skew 500 ppm
Aug 08 07:08:48 dist-test-slave-rmhg krb5kdc[20336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172928, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:08:49.001457 21592 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:08:49.001911 21592 webserver.cc:460] Webserver started at http://127.29.82.67:46219/ using document root <none> and password file <none>
I20260808 07:08:49.002130 21592 fs_manager.cc:359] Metadata directory not provided
I20260808 07:08:49.002198 21592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:08:49.003628 21592 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:49.004346 21610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:49.004546 21592 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:08:49.004657 21592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "28dd78d3f30f4970b109c1b4d649c64e"
format_stamp: "Formatted at 2026-08-08 07:08:28 on dist-test-slave-rmhg"
server_key: "04752910b77684218788f7d06d93b4db"
server_key_iv: "8b2815b909efcef2844bee3f907cf7ea"
server_key_version: "encryptionkey@0"
I20260808 07:08:49.005003 21592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:08:49.019235 21592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:08:49.021524 21592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:08:49.021672 21592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:08:49.021919 21592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:08:49.022243 21592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:08:49.022279 21592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:49.022308 21592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:08:49.022326 21592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:08:49.027987 21592 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:43121
I20260808 07:08:49.028033 21772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:43121 every 8 connection(s)
I20260808 07:08:49.028383 21592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:08:49.030357 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 21592
Aug 08 07:08:49 dist-test-slave-rmhg krb5kdc[20336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172928, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:08:49.037806 21778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.030824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53410 (local address 127.29.82.126:34571)
0808 07:08:49.031289 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.031290 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.031297 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:08:49.031315 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.031315 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.031325 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.031373 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:49.031988 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.032416 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.033404 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.033600 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.033654 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.034952 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:49.034954 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:49.034955 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:49.034962 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:49.036676 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:49.037002 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:49.037003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:49.037004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:49.037060 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:49.037259 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:49.037260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:49.037261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:49.037373 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:49.037540 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.037590 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.037673 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":73,"threads_started":1}
I20260808 07:08:49.038522 21414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.029190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:32845 (local address 127.29.82.126:34571)
0808 07:08:49.029250 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.029253 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.029451 (+ 198us) server_negotiation.cc:407] Connection header received
0808 07:08:49.030027 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.030029 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.030040 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.030107 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:49.031275 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.031803 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.033076 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.033358 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.033425 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.035724 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:49.035725 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:49.035726 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:49.035732 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:49.037017 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:49.037439 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:49.037440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:49.037441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:49.037496 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:49.037718 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:49.037718 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:49.037719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:49.037866 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:49.037935 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.038301 (+ 366us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.038392 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":26}
I20260808 07:08:49.038545 21776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.029121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:32845)
0808 07:08:49.029324 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:49.029364 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:49.029910 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:49.030186 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:49.030190 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:49.030880 (+ 690us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:08:49.031175 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.031180 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.031907 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.031908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.032964 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.032967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.033466 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.033467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.033603 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.034140 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:08:49.034151 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:08:49.035636 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:08:49.037096 (+ 1460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:49.037103 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:49.037106 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:49.037373 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:49.037553 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:08:49.037554 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:08:49.037554 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:08:49.037662 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:08:49.037935 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:08:49.037944 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:08:49.038120 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 07:08:49.038226 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 07:08:49.038361 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":113,"threads_started":1}
I20260808 07:08:49.038992 21773 heartbeater.cc:347] Connected to a master server at 127.29.82.126:34571
I20260808 07:08:49.039085 21773 heartbeater.cc:464] Registering TS with master...
I20260808 07:08:49.039240 21773 heartbeater.cc:511] Master 127.29.82.126:34571 requested a full tablet report, sending...
I20260808 07:08:49.039570 21141 ts_manager.cc:194] Registered new tserver with Master: 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121)
I20260808 07:08:49.039943 21141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:32845
I20260808 07:08:49.049525 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:08:49.052515 21414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.049908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53424 (local address 127.29.82.126:34571)
0808 07:08:49.049973 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.049975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.050065 (+ 90us) server_negotiation.cc:407] Connection header received
0808 07:08:49.050160 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.050161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.050209 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.050266 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:08:49.050407 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.051002 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.051787 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.051998 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.052056 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.052218 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:08:49.052276 (+ 58us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 07:08:49.052442 (+ 166us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53424: token expired
Metrics: {"server-negotiator.queue_time_us":33}
W20260808 07:08:49.052589 21414 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53424: token expired
W20260808 07:08:49.053402 21047 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.29.82.126:34571)
I20260808 07:08:49.059092 21414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.053692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53438 (local address 127.29.82.126:34571)
0808 07:08:49.053743 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.053744 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.053752 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:08:49.053771 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.053771 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.053779 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.053824 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:08:49.054316 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.054781 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.055428 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.055617 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.055660 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.056770 (+ 1110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:08:49.056771 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:08:49.056771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:08:49.056778 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:08:49.058110 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:49.058427 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:49.058428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:49.058428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:49.058475 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:08:49.058683 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:08:49.058683 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:08:49.058683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:08:49.058778 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:08:49.058846 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.058958 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.059013 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:08:49.060360 21141 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53438:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:08:49.062072 21141 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:08:49.064486 21314 tablet_service.cc:1467] Processing CreateTablet for tablet adf57bf824b144a2acf2f99e227222ea (DEFAULT_TABLE table=test-table [id=ccbf92d82da5481ba05aebd0ffce8d84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:49.064720 21314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf57bf824b144a2acf2f99e227222ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:49.066431 21254 tablet_bootstrap.cc:492] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811: Bootstrap starting.
I20260808 07:08:49.066841 21254 tablet_bootstrap.cc:654] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:49.067528 21254 tablet_bootstrap.cc:492] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811: No bootstrap required, opened a new log
I20260808 07:08:49.067592 21254 ts_tablet_manager.cc:1397] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 07:08:49.067956 21254 raft_consensus.cc:348] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:08:49.068054 21254 raft_consensus.cc:374] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:49.068111 21254 raft_consensus.cc:729] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d5af7874034b4f9220b974825c7811, State: Initialized, Role: FOLLOWER
I20260808 07:08:49.068171 21254 consensus_queue.cc:260] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:08:49.068265 21254 ts_tablet_manager.cc:1428] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 07:08:49.068560 21783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.064113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:43121 (local address 127.0.0.1:34034)
0808 07:08:49.064325 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:49.064333 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:49.064373 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:49.064794 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:49.064795 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:49.064798 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:49.064850 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.064851 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.065957 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.065959 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.067130 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.067192 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.068270 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.068271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.068352 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.068379 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 07:08:49.068434 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 07:08:49.068483 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":23,"thread_start_us":128,"threads_started":1}
I20260808 07:08:49.068599 21784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.064318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34034 (local address 127.29.82.67:43121)
0808 07:08:49.064514 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.064518 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.064526 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:08:49.064586 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.064588 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.064606 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.064686 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:49.064963 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.065875 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.067255 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.068026 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.068154 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.068229 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.068469 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.068513 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":109,"threads_started":1}
I20260808 07:08:49.068674 21417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.064113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:45501 (local address 127.0.0.1:54376)
0808 07:08:49.064166 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:49.064180 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:49.064229 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:49.064946 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:49.064948 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:49.064950 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:49.064996 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.064997 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.066321 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.066321 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.067338 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.067340 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.068421 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.068423 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.068502 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.068507 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:08:49.068555 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 07:08:49.068606 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 07:08:49.068919 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.064535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54376 (local address 127.29.82.66:45501)
0808 07:08:49.064768 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.064773 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.064783 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:08:49.064822 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.064824 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.064839 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.065065 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:49.065188 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.066228 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.067409 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.068237 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.068314 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.068385 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.068794 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.068841 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":122,"threads_started":1}
I20260808 07:08:49.069379 21681 tablet_service.cc:1467] Processing CreateTablet for tablet adf57bf824b144a2acf2f99e227222ea (DEFAULT_TABLE table=test-table [id=ccbf92d82da5481ba05aebd0ffce8d84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:49.069540 21503 tablet_service.cc:1467] Processing CreateTablet for tablet adf57bf824b144a2acf2f99e227222ea (DEFAULT_TABLE table=test-table [id=ccbf92d82da5481ba05aebd0ffce8d84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:08:49.069772 21681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf57bf824b144a2acf2f99e227222ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:49.069844 21503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf57bf824b144a2acf2f99e227222ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:08:49.073443 21789 tablet_bootstrap.cc:492] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e: Bootstrap starting.
I20260808 07:08:49.073501 21791 tablet_bootstrap.cc:492] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34: Bootstrap starting.
I20260808 07:08:49.074258 21789 tablet_bootstrap.cc:654] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:49.074306 21791 tablet_bootstrap.cc:654] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34: Neither blocks nor log segments found. Creating new log.
I20260808 07:08:49.074905 21789 log.cc:824] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:49.074929 21791 log.cc:824] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34: Log is configured to *not* fsync() on all Append() calls
I20260808 07:08:49.075793 21791 tablet_bootstrap.cc:492] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34: No bootstrap required, opened a new log
I20260808 07:08:49.075809 21789 tablet_bootstrap.cc:492] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e: No bootstrap required, opened a new log
I20260808 07:08:49.075861 21789 ts_tablet_manager.cc:1397] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:08:49.075860 21791 ts_tablet_manager.cc:1397] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:08:49.077623 21789 raft_consensus.cc:348] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:08:49.077775 21789 raft_consensus.cc:374] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:49.077800 21789 raft_consensus.cc:729] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28dd78d3f30f4970b109c1b4d649c64e, State: Initialized, Role: FOLLOWER
I20260808 07:08:49.077759 21791 raft_consensus.cc:348] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:08:49.077935 21791 raft_consensus.cc:374] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:08:49.077908 21789 consensus_queue.cc:260] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:08:49.077978 21791 raft_consensus.cc:729] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffedfceb407c4a1f80ce808546b03a34, State: Initialized, Role: FOLLOWER
I20260808 07:08:49.078087 21791 consensus_queue.cc:260] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:08:49.078220 21789 ts_tablet_manager.cc:1428] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:08:49.078238 21773 heartbeater.cc:503] Master 127.29.82.126:34571 was elected leader, sending a full tablet report...
I20260808 07:08:49.078379 21791 ts_tablet_manager.cc:1428] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:08:49.078519 21589 heartbeater.cc:503] Master 127.29.82.126:34571 was elected leader, sending a full tablet report...
I20260808 07:08:49.103770 21796 raft_consensus.cc:482] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:08:49.103909 21796 raft_consensus.cc:504] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:08:49.104308 21796 leader_election.cc:288] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121), c9d5af7874034b4f9220b974825c7811 (127.29.82.65:42895)
I20260808 07:08:49.108167 21784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.104555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:47703 (local address 127.29.82.67:43121)
0808 07:08:49.104691 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.104693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.104703 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:08:49.104734 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.104735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.104744 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.104824 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:49.105011 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.105774 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.107197 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.107763 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.107836 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.107847 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.108047 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.108096 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260808 07:08:49.108217 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.104606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:36911 (local address 127.29.82.65:42895)
0808 07:08:49.104656 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.104658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.104854 (+ 196us) server_negotiation.cc:407] Connection header received
0808 07:08:49.104983 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.104984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.105016 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.105080 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:08:49.105257 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.105943 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.107197 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.107854 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.107918 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.108016 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.108103 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.108148 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:08:49.108191 21591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.104495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:43121 (local address 127.29.82.66:47703)
0808 07:08:49.104589 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:49.104602 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:49.104654 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:49.104851 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:49.104853 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:49.104855 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:49.104932 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.104935 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.105853 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.105854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.107071 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.107074 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.107865 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.107866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.107964 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.107970 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:08:49.108038 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 07:08:49.108088 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":27}
I20260808 07:08:49.108196 21797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.104502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:42895 (local address 127.29.82.66:36911)
0808 07:08:49.104796 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:49.104804 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:08:49.104880 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:08:49.105091 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:08:49.105092 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:08:49.105094 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:08:49.105184 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.105186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.106016 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.106018 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.107104 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:08:49.107105 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.107969 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.107970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:08:49.108032 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.108036 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:08:49.108087 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 07:08:49.108117 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":62,"thread_start_us":108,"threads_started":1}
I20260808 07:08:49.108570 21716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf57bf824b144a2acf2f99e227222ea" candidate_uuid: "ffedfceb407c4a1f80ce808546b03a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28dd78d3f30f4970b109c1b4d649c64e" is_pre_election: true
I20260808 07:08:49.108745 21716 raft_consensus.cc:2454] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffedfceb407c4a1f80ce808546b03a34 in term 0.
I20260808 07:08:49.108685 21341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf57bf824b144a2acf2f99e227222ea" candidate_uuid: "ffedfceb407c4a1f80ce808546b03a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d5af7874034b4f9220b974825c7811" is_pre_election: true
I20260808 07:08:49.108827 21341 raft_consensus.cc:2454] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffedfceb407c4a1f80ce808546b03a34 in term 0.
I20260808 07:08:49.109014 21445 leader_election.cc:302] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28dd78d3f30f4970b109c1b4d649c64e, ffedfceb407c4a1f80ce808546b03a34; no voters:
I20260808 07:08:49.109181 21796 raft_consensus.cc:2781] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:08:49.109246 21796 raft_consensus.cc:482] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:08:49.109263 21796 raft_consensus.cc:3037] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:49.109984 21796 raft_consensus.cc:504] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:08:49.110116 21796 leader_election.cc:288] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [CANDIDATE]: Term 1 election: Requested vote from peers 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121), c9d5af7874034b4f9220b974825c7811 (127.29.82.65:42895)
I20260808 07:08:49.110292 21716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf57bf824b144a2acf2f99e227222ea" candidate_uuid: "ffedfceb407c4a1f80ce808546b03a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28dd78d3f30f4970b109c1b4d649c64e"
I20260808 07:08:49.110286 21341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf57bf824b144a2acf2f99e227222ea" candidate_uuid: "ffedfceb407c4a1f80ce808546b03a34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d5af7874034b4f9220b974825c7811"
I20260808 07:08:49.110383 21341 raft_consensus.cc:3037] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:49.110384 21716 raft_consensus.cc:3037] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:08:49.111281 21716 raft_consensus.cc:2454] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffedfceb407c4a1f80ce808546b03a34 in term 1.
I20260808 07:08:49.111281 21341 raft_consensus.cc:2454] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffedfceb407c4a1f80ce808546b03a34 in term 1.
I20260808 07:08:49.111501 21436 leader_election.cc:302] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9d5af7874034b4f9220b974825c7811, ffedfceb407c4a1f80ce808546b03a34; no voters:
I20260808 07:08:49.111615 21796 raft_consensus.cc:2781] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:08:49.111780 21796 raft_consensus.cc:686] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [term 1 LEADER]: Becoming Leader. State: Replica: ffedfceb407c4a1f80ce808546b03a34, State: Running, Role: LEADER
I20260808 07:08:49.111881 21796 consensus_queue.cc:237] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:08:49.112862 21140 catalog_manager.cc:5495] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66). New cstate: current_term: 1 leader_uuid: "ffedfceb407c4a1f80ce808546b03a34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } health_report { overall_health: UNKNOWN } } }
I20260808 07:08:49.118985 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.116603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54390 (local address 127.29.82.66:45501)
0808 07:08:49.116664 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:08:49.116666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:08:49.116673 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:08:49.116702 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:08:49.116703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:08:49.116719 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:08:49.116776 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:08:49.116873 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.117398 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.118127 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:08:49.118331 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:08:49.118382 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:08:49.118613 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:08:49.118718 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:08:49.118794 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 07:08:49.118869 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 07:08:49.118890 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:08:49.120823 21716 raft_consensus.cc:1261] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e [term 1 FOLLOWER]: Refusing update from remote peer ffedfceb407c4a1f80ce808546b03a34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:08:49.120824 21341 raft_consensus.cc:1261] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Refusing update from remote peer ffedfceb407c4a1f80ce808546b03a34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:08:49.121201 21796 consensus_queue.cc:1035] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:08:49.121351 21799 consensus_queue.cc:1035] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:08:49.124224 21804 mvcc.cc:205] Tried to move back new op lower bound from 7316164317676216320 to 7316164317643014144. Current Snapshot: MvccSnapshot[applied={T|T < 7316164317676216320}]
I20260808 07:08:49.124352 21803 mvcc.cc:205] Tried to move back new op lower bound from 7316164317676216320 to 7316164317643014144. Current Snapshot: MvccSnapshot[applied={T|T < 7316164317676216320}]
I20260808 07:08:49.125797 21141 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:08:49.125886 21141 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:08:49.126621 21141 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Sending DeleteTablet for 3 replicas of tablet adf57bf824b144a2acf2f99e227222ea
I20260808 07:08:49.126959 21681 tablet_service.cc:1514] Processing DeleteTablet for tablet adf57bf824b144a2acf2f99e227222ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:49 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:34034
I20260808 07:08:49.126997 21503 tablet_service.cc:1514] Processing DeleteTablet for tablet adf57bf824b144a2acf2f99e227222ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:49 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:54376
I20260808 07:08:49.127182 21314 tablet_service.cc:1514] Processing DeleteTablet for tablet adf57bf824b144a2acf2f99e227222ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:08:49 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:51390
I20260808 07:08:49.127206 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 21193
I20260808 07:08:49.127286 21419 tablet_replica.cc:330] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811: stopping tablet replica
I20260808 07:08:49.127321 21813 tablet_replica.cc:330] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34: stopping tablet replica
I20260808 07:08:49.127348 21419 raft_consensus.cc:2229] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:08:49.127390 21419 raft_consensus.cc:2258] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:49.127403 21813 raft_consensus.cc:2229] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:08:49.131088 21813 raft_consensus.cc:2258] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:49.134105 21812 tablet_replica.cc:330] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e: stopping tablet replica
I20260808 07:08:49.134248 21812 raft_consensus.cc:2229] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:08:49.134353 21812 raft_consensus.cc:2258] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:08:49.134716 21813 ts_tablet_manager.cc:1905] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:08:49.136489 21812 ts_tablet_manager.cc:1905] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:08:49.136523 21813 ts_tablet_manager.cc:1918] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:08:49.136591 21813 log.cc:1196] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/adf57bf824b144a2acf2f99e227222ea
I20260808 07:08:49.136868 21813 ts_tablet_manager.cc:1939] T adf57bf824b144a2acf2f99e227222ea P ffedfceb407c4a1f80ce808546b03a34: Deleting consensus metadata
I20260808 07:08:49.137372 21118 catalog_manager.cc:4841] TS ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501): tablet adf57bf824b144a2acf2f99e227222ea (table test-table [id=ccbf92d82da5481ba05aebd0ffce8d84]) successfully deleted
I20260808 07:08:49.138471 21812 ts_tablet_manager.cc:1918] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:08:49.138556 21812 log.cc:1196] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/adf57bf824b144a2acf2f99e227222ea
I20260808 07:08:49.138799 21812 ts_tablet_manager.cc:1939] T adf57bf824b144a2acf2f99e227222ea P 28dd78d3f30f4970b109c1b4d649c64e: Deleting consensus metadata
I20260808 07:08:49.139257 21122 catalog_manager.cc:4841] TS 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121): tablet adf57bf824b144a2acf2f99e227222ea (table test-table [id=ccbf92d82da5481ba05aebd0ffce8d84]) successfully deleted
W20260808 07:08:49.145380 21118 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:42895 (error 108)
I20260808 07:08:49.145823 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 21416
I20260808 07:08:49.146025 21417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:08:49.145802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:42895 (local address 127.0.0.1:51400)
0808 07:08:49.145859 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 07:08:49.145987 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 07:08:49.148176 21118 catalog_manager.cc:4584] TS c9d5af7874034b4f9220b974825c7811 (127.29.82.65:42895): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet adf57bf824b144a2acf2f99e227222ea: Network error: Client connection negotiation failed: client connection to 127.29.82.65:42895: connect: Connection refused (error 111)
I20260808 07:08:49.157898 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 21592
I20260808 07:08:49.168613 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 21096
I20260808 07:09:09.181288 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:34571
--webserver_interface=127.29.82.126
--webserver_port=38741
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:34571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:09.265637 21815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:09.265856 21815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:09.265879 21815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:09.267051 21815 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 07:09:09.267094 21815 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 07:09:09.267105 21815 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 07:09:09.267115 21815 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:09.267127 21815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:09.267143 21815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:09.267166 21815 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:09.267189 21815 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:09.268709 21815 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:34571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:34571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=38741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:09.268954 21815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:09.269222 21815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:09:09.274267 21815 server_base.cc:1034] running on GCE node
W20260808 07:09:09.274235 21824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:09.274250 21825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:09.274248 21827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:09.274737 21815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:09.275045 21815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:09.276194 21815 hybrid_clock.cc:648] HybridClock initialized: now 1786172949276182 us; error 31 us; skew 500 ppm
Aug 08 07:09:09 dist-test-slave-rmhg krb5kdc[20336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172949, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:09.278898 21815 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:09:09.279342 21815 webserver.cc:460] Webserver started at http://127.29.82.126:38741/ using document root <none> and password file <none>
I20260808 07:09:09.279574 21815 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:09.279630 21815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:09.280973 21815 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:09.281705 21834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:09.281862 21815 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:09.281955 21815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "75048b4ce01c4a99a22c3ca214e60c7e"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "7f2debf3a9b589f1110ab2e35888eff1"
server_key_iv: "3a40c739402d8cc5c4147a33d3401e5f"
server_key_version: "encryptionkey@0"
I20260808 07:09:09.282292 21815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:09.290279 21815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:09.292107 21815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:09.292245 21815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:09.296303 21815 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:34571
I20260808 07:09:09.296353 21916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:34571 every 8 connection(s)
I20260808 07:09:09.296717 21815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:09.297511 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 21815
I20260808 07:09:09.297803 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:42895
--local_ip_for_outbound_sockets=127.29.82.65
--tserver_master_addrs=127.29.82.126:34571
--webserver_port=36067
--webserver_interface=127.29.82.65
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:09:09.298390 21917 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:09:09.299055 21917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Bootstrap starting.
I20260808 07:09:09.307932 21917 log.cc:824] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:09.310581 21917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:09:09.310916 21917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Bootstrap complete.
I20260808 07:09:09.313127 21917 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } }
I20260808 07:09:09.313422 21917 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75048b4ce01c4a99a22c3ca214e60c7e, State: Initialized, Role: FOLLOWER
I20260808 07:09:09.313598 21917 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } }
I20260808 07:09:09.313663 21917 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:09.313706 21917 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:09.313755 21917 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:09:09.314870 21917 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } }
I20260808 07:09:09.314972 21917 leader_election.cc:302] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75048b4ce01c4a99a22c3ca214e60c7e; no voters:
I20260808 07:09:09.315177 21917 leader_election.cc:288] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 07:09:09.315237 21922 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 3 FOLLOWER]: Leader election won for term 3
I20260808 07:09:09.315364 21922 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [term 3 LEADER]: Becoming Leader. State: Replica: 75048b4ce01c4a99a22c3ca214e60c7e, State: Running, Role: LEADER
I20260808 07:09:09.315469 21917 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:09.315459 21922 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } }
I20260808 07:09:09.315933 21923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75048b4ce01c4a99a22c3ca214e60c7e. Latest consensus state: current_term: 3 leader_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } } }
I20260808 07:09:09.316097 21923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:09.316305 21924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75048b4ce01c4a99a22c3ca214e60c7e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 34571 } } }
I20260808 07:09:09.316406 21927 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:09.316426 21924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:09.317518 21927 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:09.317720 21927 catalog_manager.cc:1259] Loaded cluster ID: 37d58589e6614805b73bbb9b15932860
I20260808 07:09:09.317889 21927 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:09.318719 21927 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:09.318905 21927 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Loaded TSK: 0
I20260808 07:09:09.318956 21927 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 75048b4ce01c4a99a22c3ca214e60c7e: Loaded TSK: 1
F20260808 07:09:09.319180 21927 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f0785ab59ad google::LogMessage::Fail() at ??:0
@ 0x7f0785ab888a google::LogMessage::SendToLog() at ??:0
@ 0x7f0785ab54de google::LogMessage::Flush() at ??:0
@ 0x7f0785ab6a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f0788222104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f078821fd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f078da0f1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f078da0f48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f078da0f594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f078d9d5c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f078d9dfad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f07879830d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f0787978954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f07887dc6db start_thread at ??:0
@ 0x7f07845b361f clone at ??:0
W20260808 07:09:09.402590 21919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:09.402801 21919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:09.402825 21919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:09.404002 21919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:09.404047 21919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:09.404074 21919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:09:09.405651 21919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:42895
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=36067
--tserver_master_addrs=127.29.82.126:34571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:09.405890 21919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:09.406121 21919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:09.411309 21977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:09.411351 21972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:09.411350 21971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:09.411656 21919 server_base.cc:1034] running on GCE node
I20260808 07:09:09.411839 21919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:09.412065 21919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:09.413218 21919 hybrid_clock.cc:648] HybridClock initialized: now 1786172949413199 us; error 35 us; skew 500 ppm
Aug 08 07:09:09 dist-test-slave-rmhg krb5kdc[20336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172949, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:09.415838 21919 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:09:09.416294 21919 webserver.cc:460] Webserver started at http://127.29.82.65:36067/ using document root <none> and password file <none>
I20260808 07:09:09.416534 21919 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:09.416586 21919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:09.418073 21919 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:09.418774 21986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:09.418933 21919 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:09.419014 21919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "c9d5af7874034b4f9220b974825c7811"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "75faf1ad54ce104349dfc2f2e258573f"
server_key_iv: "532635f510775c2e63b61d241c4b30f6"
server_key_version: "encryptionkey@0"
I20260808 07:09:09.419386 21919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:09.435318 21919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:09.437494 21919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:09.437640 21919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:09.437884 21919 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:09.438339 21995 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 07:09:09.440428 21919 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 07:09:09.440528 21919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 07:09:09.440568 21919 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 07:09:09.441277 21919 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 07:09:09.441311 21919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:09.441404 21995 tablet_bootstrap.cc:492] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811: Bootstrap starting.
I20260808 07:09:09.448146 21919 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:42895
I20260808 07:09:09.448207 22155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:42895 every 8 connection(s)
I20260808 07:09:09.448597 21919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:09:09.452911 21995 log.cc:824] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:09.454375 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 21919
I20260808 07:09:09.454674 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:45501
--local_ip_for_outbound_sockets=127.29.82.66
--tserver_master_addrs=127.29.82.126:34571
--webserver_port=41319
--webserver_interface=127.29.82.66
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:09:09.455811 21995 tablet_bootstrap.cc:492] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:09:09.456135 21995 tablet_bootstrap.cc:492] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811: Bootstrap complete.
I20260808 07:09:09.457330 21995 ts_tablet_manager.cc:1397] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.011s
I20260808 07:09:09.458818 21995 raft_consensus.cc:348] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:09:09.459177 21995 raft_consensus.cc:729] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d5af7874034b4f9220b974825c7811, State: Initialized, Role: FOLLOWER
I20260808 07:09:09.459371 21995 consensus_queue.cc:260] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:09:09.459728 21995 ts_tablet_manager.cc:1428] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
W20260808 07:09:09.515766 22158 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:09:09.449361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:42879)
0808 07:09:09.449550 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:09.449588 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:09.450032 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:09.515584 (+ 65552us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":99,"threads_started":1}
W20260808 07:09:09.516006 22156 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:34571 (0 consecutive failures): Network error: Failed to ping master at 127.29.82.126:34571: Client connection negotiation failed: client connection to 127.29.82.126:34571: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:09:09.516331 22158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:09.516221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:46921)
0808 07:09:09.516269 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:09.516311 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 07:09:09.516698 22158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:09.516615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:57343)
0808 07:09:09.516658 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:09.516682 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 07:09:09.516820 22156 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:09:09.542114 22161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:09.542320 22161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:09.542343 22161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:09.543462 22161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:09.543500 22161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:09.543525 22161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:09:09.545275 22161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:45501
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=41319
--tserver_master_addrs=127.29.82.126:34571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:09.545487 22161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:09.545686 22161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:09.550681 22171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:09.550741 22172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:09.550693 22174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:09.551056 22161 server_base.cc:1034] running on GCE node
I20260808 07:09:09.551276 22161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:09.551512 22161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:09.552822 22161 hybrid_clock.cc:648] HybridClock initialized: now 1786172949552812 us; error 28 us; skew 500 ppm
Aug 08 07:09:09 dist-test-slave-rmhg krb5kdc[20336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172949, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:09.555401 22161 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:09:09.555972 22161 webserver.cc:460] Webserver started at http://127.29.82.66:41319/ using document root <none> and password file <none>
I20260808 07:09:09.556181 22161 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:09.556226 22161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:09.557618 22161 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:09.558182 22183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:09.558326 22161 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:09:09.558409 22161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "ffedfceb407c4a1f80ce808546b03a34"
format_stamp: "Formatted at 2026-08-08 07:08:27 on dist-test-slave-rmhg"
server_key: "4476fc3d7f8086419573c11a4eb61282"
server_key_iv: "442bc847f448c73529fa1ac271cf9dc2"
server_key_version: "encryptionkey@0"
I20260808 07:09:09.558779 22161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:09.576187 22161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:09.578644 22161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:09.578774 22161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:09.579034 22161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:09.579375 22161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:09.579411 22161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:09.579442 22161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:09.579460 22161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:09.585274 22161 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:45501
I20260808 07:09:09.585317 22333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:45501 every 8 connection(s)
I20260808 07:09:09.585672 22161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:09:09.586755 22339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:09.586351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:46581)
0808 07:09:09.586511 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:09.586582 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
W20260808 07:09:09.587116 22334 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:34571 (0 consecutive failures): Network error: Failed to ping master at 127.29.82.126:34571: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
I20260808 07:09:09.587374 22339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:09.587283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:51417)
0808 07:09:09.587332 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:09.587357 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 07:09:09.587589 22339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:09.587540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:44987)
0808 07:09:09.587560 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:09.587577 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260808 07:09:09.587684 22334 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 07:09:09.591637 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 22161
I20260808 07:09:09.591933 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:43121
--local_ip_for_outbound_sockets=127.29.82.67
--tserver_master_addrs=127.29.82.126:34571
--webserver_port=46219
--webserver_interface=127.29.82.67
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:09.676059 22340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:09.676276 22340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:09.676299 22340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:09.677495 22340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:09.677537 22340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:09.677564 22340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:09:09.679080 22340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:43121
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=46219
--tserver_master_addrs=127.29.82.126:34571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:09.679337 22340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:09.679563 22340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:09.684722 22354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:09.684768 22346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:09.684732 22351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:09.684877 22340 server_base.cc:1034] running on GCE node
I20260808 07:09:09.685205 22340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:09.685484 22340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:09.686635 22340 hybrid_clock.cc:648] HybridClock initialized: now 1786172949686618 us; error 30 us; skew 500 ppm
Aug 08 07:09:09 dist-test-slave-rmhg krb5kdc[20336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172949, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:09.689054 22340 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:09:09.689510 22340 webserver.cc:460] Webserver started at http://127.29.82.67:46219/ using document root <none> and password file <none>
I20260808 07:09:09.689736 22340 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:09.689787 22340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:09.691144 22340 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:09.691817 22362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:09.691982 22340 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:09.692080 22340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "28dd78d3f30f4970b109c1b4d649c64e"
format_stamp: "Formatted at 2026-08-08 07:08:28 on dist-test-slave-rmhg"
server_key: "04752910b77684218788f7d06d93b4db"
server_key_iv: "8b2815b909efcef2844bee3f907cf7ea"
server_key_version: "encryptionkey@0"
I20260808 07:09:09.692423 22340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:09.708865 22340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:09.710780 22340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:09.710933 22340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:09.711179 22340 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:09.711496 22340 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:09.711531 22340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:09.711562 22340 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:09.711580 22340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:09.717347 22340 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:43121
I20260808 07:09:09.717422 22513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:43121 every 8 connection(s)
I20260808 07:09:09.717756 22340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:09:09.717999 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 22340
I20260808 07:09:09.718945 22522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:09.718477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:33447)
0808 07:09:09.718660 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:09.718750 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":103,"threads_started":1}
W20260808 07:09:09.719328 22515 heartbeater.cc:644] Failed to heartbeat to 127.29.82.126:34571 (0 consecutive failures): Network error: Failed to ping master at 127.29.82.126:34571: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
I20260808 07:09:09.719595 22522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:09.719507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:44029)
0808 07:09:09.719551 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:09.719576 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 07:09:09.719846 22522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:09.719770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:45939)
0808 07:09:09.719806 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:09.719827 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 07:09:09.719934 22515 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 07:09:10.517681 22525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:10.517386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:38153)
0808 07:09:10.517565 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:10.517613 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":68,"threads_started":1}
I20260808 07:09:10.588213 22527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:10.587997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:49623)
0808 07:09:10.588112 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:10.588149 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":58,"threads_started":1}
I20260808 07:09:10.720482 22528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:10.720265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:42353)
0808 07:09:10.720385 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:10.720428 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":64,"threads_started":1}
I20260808 07:09:10.897524 22529 raft_consensus.cc:482] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:10.897655 22529 raft_consensus.cc:504] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:09:10.897946 22529 leader_election.cc:288] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121), ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501)
Aug 08 07:09:10 dist-test-slave-rmhg krb5kdc[20336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172949, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.67@KRBTEST.COM
Aug 08 07:09:10 dist-test-slave-rmhg krb5kdc[20336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172949, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.66@KRBTEST.COM
I20260808 07:09:10.909580 22525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:10.898139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:45501 (local address 127.29.82.65:42791)
0808 07:09:10.898200 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:10.898213 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:10.898288 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:10.899206 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:10.899207 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:10.899523 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:10.899721 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:10.899727 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:10.900858 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:10.900859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:10.901720 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:10.901723 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:10.902305 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:10.902307 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:10.902421 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:10.902957 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:10.902966 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:10.905085 (+ 2119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:10.907440 (+ 2355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:10.907450 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:10.907453 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:10.907886 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:10.908199 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:10.908200 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:10.908200 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:10.908390 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:10.908907 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:10.908918 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:10.909095 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 07:09:10.909271 (+ 176us) client_negotiation.cc:240] Negotiation successful
0808 07:09:10.909470 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":6}
I20260808 07:09:10.909593 22531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:10.898238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:53133 (local address 127.29.82.67:43121)
0808 07:09:10.898394 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:10.898405 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:10.898436 (+ 31us) server_negotiation.cc:407] Connection header received
0808 07:09:10.898869 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:10.898871 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:10.898913 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:10.899035 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:10.899846 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:10.900773 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:10.901817 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:10.902214 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:10.902323 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:10.905242 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:10.905248 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:10.905249 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:10.905264 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:10.907347 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:10.907977 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:10.907981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:10.907982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:10.908104 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:10.908467 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:10.908468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:10.908468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:10.908807 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:10.908897 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:10.909331 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 07:09:10.909475 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":56,"threads_started":1}
I20260808 07:09:10.909593 22532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:10.898411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:42791 (local address 127.29.82.66:45501)
0808 07:09:10.898543 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:10.898552 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:10.898582 (+ 30us) server_negotiation.cc:407] Connection header received
0808 07:09:10.899021 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:10.899025 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:10.899080 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:10.899223 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:10.899832 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:10.900763 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:10.901816 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:10.902218 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:10.902318 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:10.905262 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:10.905266 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:10.905266 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:10.905276 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:10.907331 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:10.907977 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:10.907981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:10.907982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:10.908104 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:10.908464 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:10.908465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:10.908465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:10.908807 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:10.908897 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:10.909331 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 07:09:10.909476 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":53,"threads_started":1}
I20260808 07:09:10.909658 22530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:10.898139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:43121 (local address 127.29.82.65:53133)
0808 07:09:10.898282 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:10.898292 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:10.898346 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:10.899109 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:10.899113 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:10.899523 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:10.899721 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:10.899727 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:10.900872 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:10.900872 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:10.901722 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:10.901725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:10.902302 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:10.902304 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:10.902419 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:10.902991 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:10.902996 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:10.905085 (+ 2089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:10.907481 (+ 2396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:10.907482 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:10.907483 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:10.907886 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:10.908199 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:10.908200 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:10.908200 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:10.908390 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:10.908908 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:10.908918 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:10.909095 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 07:09:10.909271 (+ 176us) client_negotiation.cc:240] Negotiation successful
0808 07:09:10.909552 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":248,"thread_start_us":68,"threads_started":1}
W20260808 07:09:10.911022 21990 leader_election.cc:341] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121): Not found: Tablet not found: adf57bf824b144a2acf2f99e227222ea
W20260808 07:09:10.911127 21987 leader_election.cc:341] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501): Not found: Tablet not found: adf57bf824b144a2acf2f99e227222ea
I20260808 07:09:10.911196 21987 leader_election.cc:302] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9d5af7874034b4f9220b974825c7811; no voters: 28dd78d3f30f4970b109c1b4d649c64e, ffedfceb407c4a1f80ce808546b03a34
I20260808 07:09:10.911315 22529 raft_consensus.cc:2726] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:09:11.518399 22533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:11.518158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:58843)
0808 07:09:11.518304 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:11.518350 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":71,"threads_started":1}
I20260808 07:09:11.589048 22534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:11.588774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:47575)
0808 07:09:11.588945 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:11.589002 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":74,"threads_started":1}
I20260808 07:09:11.721230 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:11.720979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:60341)
0808 07:09:11.721108 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:11.721178 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260808 07:09:12.519192 22537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:12.518953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:54483)
0808 07:09:12.519094 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:12.519142 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":75,"threads_started":1}
I20260808 07:09:12.589792 22540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:12.589531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:35695)
0808 07:09:12.589697 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:12.589744 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":70,"threads_started":1}
I20260808 07:09:12.721974 22541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:12.721741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:52581)
0808 07:09:12.721870 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:12.721914 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
I20260808 07:09:12.967950 22542 raft_consensus.cc:482] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:12.968070 22542 raft_consensus.cc:504] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:09:12.968246 22542 leader_election.cc:288] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121), ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501)
W20260808 07:09:12.968698 21987 leader_election.cc:341] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501): Not found: Tablet not found: adf57bf824b144a2acf2f99e227222ea
W20260808 07:09:12.968788 21990 leader_election.cc:341] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121): Not found: Tablet not found: adf57bf824b144a2acf2f99e227222ea
I20260808 07:09:12.968833 21990 leader_election.cc:302] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9d5af7874034b4f9220b974825c7811; no voters: 28dd78d3f30f4970b109c1b4d649c64e, ffedfceb407c4a1f80ce808546b03a34
I20260808 07:09:12.968911 22542 raft_consensus.cc:2726] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:09:13.519927 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:13.519660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:49281)
0808 07:09:13.519823 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:13.519869 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":67,"threads_started":1}
I20260808 07:09:13.590590 22544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:13.590331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:48053)
0808 07:09:13.590489 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:13.590535 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":66,"threads_started":1}
I20260808 07:09:13.722692 22545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:13.722428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:44463)
0808 07:09:13.722601 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:13.722646 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":63,"threads_started":1}
I20260808 07:09:14.520800 22546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:14.520537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:35749)
0808 07:09:14.520701 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:14.520750 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":89,"threads_started":1}
I20260808 07:09:14.591355 22547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:14.591093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:50223)
0808 07:09:14.591257 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:14.591306 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":73,"threads_started":1}
I20260808 07:09:14.723399 22548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:14.723152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:51923)
0808 07:09:14.723300 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:14.723348 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":67,"threads_started":1}
I20260808 07:09:15.521580 22549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:15.521335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:60419)
0808 07:09:15.521482 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:15.521529 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":65,"threads_started":1}
I20260808 07:09:15.592027 22552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:15.591811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:38811)
0808 07:09:15.591949 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:15.591981 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
I20260808 07:09:15.724169 22553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:15.723898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:51711)
0808 07:09:15.724073 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:15.724119 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":83,"threads_started":1}
I20260808 07:09:15.783671 22555 raft_consensus.cc:482] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:15.783811 22555 raft_consensus.cc:504] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:09:15.784000 22555 leader_election.cc:288] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121), ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501)
W20260808 07:09:15.784461 21990 leader_election.cc:341] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121): Not found: Tablet not found: adf57bf824b144a2acf2f99e227222ea
W20260808 07:09:15.784698 21987 leader_election.cc:341] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501): Not found: Tablet not found: adf57bf824b144a2acf2f99e227222ea
I20260808 07:09:15.784768 21987 leader_election.cc:302] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9d5af7874034b4f9220b974825c7811; no voters: 28dd78d3f30f4970b109c1b4d649c64e, ffedfceb407c4a1f80ce808546b03a34
I20260808 07:09:15.784847 22555 raft_consensus.cc:2726] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:09:16.522275 22556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:16.522048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:58695)
0808 07:09:16.522184 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:16.522227 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":63,"threads_started":1}
I20260808 07:09:16.592712 22557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:16.592496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:55599)
0808 07:09:16.592622 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:16.592666 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":61,"threads_started":1}
I20260808 07:09:16.724936 22558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:16.724697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:37201)
0808 07:09:16.724848 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:16.724886 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":76,"threads_started":1}
I20260808 07:09:17.523003 22559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:17.522777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:35265)
0808 07:09:17.522906 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:17.522953 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
I20260808 07:09:17.593472 22560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:17.593260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:51601)
0808 07:09:17.593386 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:17.593423 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":64,"threads_started":1}
I20260808 07:09:17.725628 22561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:17.725380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:33609)
0808 07:09:17.725538 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:17.725579 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":68,"threads_started":1}
I20260808 07:09:18.361683 22562 raft_consensus.cc:482] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:18.361791 22562 raft_consensus.cc:504] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:09:18.361990 22562 leader_election.cc:288] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121), ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501)
W20260808 07:09:18.362419 21987 leader_election.cc:341] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501): Not found: Tablet not found: adf57bf824b144a2acf2f99e227222ea
W20260808 07:09:18.362521 21990 leader_election.cc:341] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121): Not found: Tablet not found: adf57bf824b144a2acf2f99e227222ea
I20260808 07:09:18.362555 21990 leader_election.cc:302] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9d5af7874034b4f9220b974825c7811; no voters: 28dd78d3f30f4970b109c1b4d649c64e, ffedfceb407c4a1f80ce808546b03a34
I20260808 07:09:18.362646 22562 raft_consensus.cc:2726] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:09:18.523676 22563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:18.523426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:33845)
0808 07:09:18.523583 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:18.523628 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":81,"threads_started":1}
I20260808 07:09:18.594205 22564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:18.593965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:35613)
0808 07:09:18.594114 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:18.594158 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":64,"threads_started":1}
I20260808 07:09:18.726392 22566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:18.726156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:33229)
0808 07:09:18.726300 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:18.726346 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":86,"threads_started":1}
I20260808 07:09:19.524410 22567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:19.524174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:40413)
0808 07:09:19.524316 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:19.524361 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
I20260808 07:09:19.594866 22568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:19.594654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:38581)
0808 07:09:19.594776 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:19.594817 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260808 07:09:19.727269 22569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:19.726949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:45109)
0808 07:09:19.727171 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:19.727219 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":95,"threads_started":1}
I20260808 07:09:20.525070 22574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:20.524858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:60569)
0808 07:09:20.524985 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:20.525021 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":63,"threads_started":1}
I20260808 07:09:20.595511 22576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:20.595285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:38449)
0808 07:09:20.595414 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:20.595461 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":65,"threads_started":1}
I20260808 07:09:20.728127 22579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:20.727877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:47463)
0808 07:09:20.728026 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:20.728075 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
I20260808 07:09:21.525801 22580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:21.525570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:60557)
0808 07:09:21.525707 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:21.525752 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260808 07:09:21.596205 22581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:21.595987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:38919)
0808 07:09:21.596114 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:21.596156 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260808 07:09:21.728775 22582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:21.728538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:49271)
0808 07:09:21.728692 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:21.728726 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":95,"threads_started":1}
I20260808 07:09:22.526526 22583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:22.526268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:45481)
0808 07:09:22.526437 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:22.526478 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":82,"threads_started":1}
I20260808 07:09:22.596928 22584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:22.596711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:40481)
0808 07:09:22.596840 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:22.596880 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260808 07:09:22.729597 22585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:22.729316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:55751)
0808 07:09:22.729466 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:22.729528 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":69,"threads_started":1}
I20260808 07:09:23.527160 22586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:23.526927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:45153)
0808 07:09:23.527073 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:23.527113 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":68,"threads_started":1}
I20260808 07:09:23.597714 22587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:23.597452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:39931)
0808 07:09:23.597603 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:23.597649 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":75,"threads_started":1}
I20260808 07:09:23.730331 22591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:23.730065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:44111)
0808 07:09:23.730232 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:23.730279 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":90,"threads_started":1}
I20260808 07:09:24.289831 22592 raft_consensus.cc:482] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:24.289942 22592 raft_consensus.cc:504] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd78d3f30f4970b109c1b4d649c64e" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43121 } } peers { permanent_uuid: "ffedfceb407c4a1f80ce808546b03a34" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45501 } } peers { permanent_uuid: "c9d5af7874034b4f9220b974825c7811" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 42895 } }
I20260808 07:09:24.290122 22592 leader_election.cc:288] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121), ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501)
W20260808 07:09:24.290532 21990 leader_election.cc:341] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 28dd78d3f30f4970b109c1b4d649c64e (127.29.82.67:43121): Not found: Tablet not found: adf57bf824b144a2acf2f99e227222ea
W20260808 07:09:24.290611 21987 leader_election.cc:341] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffedfceb407c4a1f80ce808546b03a34 (127.29.82.66:45501): Not found: Tablet not found: adf57bf824b144a2acf2f99e227222ea
I20260808 07:09:24.290690 21987 leader_election.cc:302] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9d5af7874034b4f9220b974825c7811; no voters: 28dd78d3f30f4970b109c1b4d649c64e, ffedfceb407c4a1f80ce808546b03a34
I20260808 07:09:24.290778 22592 raft_consensus.cc:2726] T adf57bf824b144a2acf2f99e227222ea P c9d5af7874034b4f9220b974825c7811 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:09:24.527952 22593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:24.527704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.65:56257)
0808 07:09:24.527844 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:24.527886 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
I20260808 07:09:24.598520 22595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:24.598298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.66:50277)
0808 07:09:24.598426 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:24.598470 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
I20260808 07:09:24.730669 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 21919
I20260808 07:09:24.741253 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:24.730968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:34571 (local address 127.29.82.67:35219)
0808 07:09:24.741085 (+ 10117us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:24.741185 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.126:34571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10084,"thread_start_us":66,"threads_started":1}
I20260808 07:09:24.750015 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 22161
I20260808 07:09:24.768759 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 22340
2026-08-08T07:09:24Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58996 ms)
[----------] 30 tests from SecurityITest (263478 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:25 dist-test-slave-rmhg krb5kdc[22601](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:25 dist-test-slave-rmhg krb5kdc[22601](info): set up 2 sockets
Aug 08 07:09:25 dist-test-slave-rmhg krb5kdc[22601](info): commencing operation
krb5kdc: starting...
W20260808 07:09:26.351610 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:26 dist-test-slave-rmhg krb5kdc[22601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172966, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:09:26.487921 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:44239
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:43999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:44239
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:26.572265 22619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:26.572496 22619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:26.572520 22619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:26.573727 22619 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:26.573772 22619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:26.573786 22619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:26.573797 22619 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:26.573809 22619 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:26.575369 22619 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:43999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:44239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:44239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:26.575644 22619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:26.575873 22619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:26.581043 22624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:26.581061 22628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:26.581100 22626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:26.581133 22619 server_base.cc:1034] running on GCE node
I20260808 07:09:26.581513 22619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:26.581794 22619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:26.582934 22619 hybrid_clock.cc:648] HybridClock initialized: now 1786172966582915 us; error 34 us; skew 500 ppm
Aug 08 07:09:26 dist-test-slave-rmhg krb5kdc[22601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172966, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:26.585480 22619 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:09:26.585912 22619 webserver.cc:460] Webserver started at http://127.29.82.126:40511/ using document root <none> and password file <none>
I20260808 07:09:26.586148 22619 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:26.586199 22619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:26.586330 22619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:26.587385 22619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "6fd9a70dc3bc4cd5951a71219171835d"
format_stamp: "Formatted at 2026-08-08 07:09:26 on dist-test-slave-rmhg"
server_key: "865268e5153ef5b9a353e02c3969ccbb"
server_key_iv: "4df42dc8d9e314a75d75addc08fdfc05"
server_key_version: "encryptionkey@0"
I20260808 07:09:26.587721 22619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "6fd9a70dc3bc4cd5951a71219171835d"
format_stamp: "Formatted at 2026-08-08 07:09:26 on dist-test-slave-rmhg"
server_key: "865268e5153ef5b9a353e02c3969ccbb"
server_key_iv: "4df42dc8d9e314a75d75addc08fdfc05"
server_key_version: "encryptionkey@0"
I20260808 07:09:26.589056 22619 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 07:09:26.589915 22638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:26.590116 22619 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:26.590210 22619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "6fd9a70dc3bc4cd5951a71219171835d"
format_stamp: "Formatted at 2026-08-08 07:09:26 on dist-test-slave-rmhg"
server_key: "865268e5153ef5b9a353e02c3969ccbb"
server_key_iv: "4df42dc8d9e314a75d75addc08fdfc05"
server_key_version: "encryptionkey@0"
I20260808 07:09:26.590279 22619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:26.601861 22619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:26.604001 22619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:26.604156 22619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:26.608145 22619 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:44239
I20260808 07:09:26.608191 22714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:44239 every 8 connection(s)
I20260808 07:09:26.608541 22619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:26.609445 22715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:26.611837 22715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d: Bootstrap starting.
I20260808 07:09:26.612417 22715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:26.612705 22715 log.cc:824] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:26.613451 22715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d: No bootstrap required, opened a new log
I20260808 07:09:26.613694 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 22619
I20260808 07:09:26.613787 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:26.613991 30025 external_mini_cluster.cc:1428] Setting key ac7842cf3f14df938979ca061343e691
I20260808 07:09:26.615998 22715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd9a70dc3bc4cd5951a71219171835d" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44239 } }
I20260808 07:09:26.616142 22715 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:26.616163 22715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd9a70dc3bc4cd5951a71219171835d, State: Initialized, Role: FOLLOWER
I20260808 07:09:26.616279 22715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd9a70dc3bc4cd5951a71219171835d" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44239 } }
I20260808 07:09:26.616351 22715 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:26.616375 22715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:26.616420 22715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:26.616981 22715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd9a70dc3bc4cd5951a71219171835d" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44239 } }
I20260808 07:09:26.617079 22715 leader_election.cc:302] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6fd9a70dc3bc4cd5951a71219171835d; no voters:
I20260808 07:09:26.617272 22715 leader_election.cc:288] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:26.617303 22722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:26.617449 22722 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [term 1 LEADER]: Becoming Leader. State: Replica: 6fd9a70dc3bc4cd5951a71219171835d, State: Running, Role: LEADER
I20260808 07:09:26.617559 22715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:26.617551 22722 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd9a70dc3bc4cd5951a71219171835d" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44239 } }
I20260808 07:09:26.617942 22722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fd9a70dc3bc4cd5951a71219171835d. Latest consensus state: current_term: 1 leader_uuid: "6fd9a70dc3bc4cd5951a71219171835d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd9a70dc3bc4cd5951a71219171835d" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44239 } } }
I20260808 07:09:26.618026 22722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:26.618194 22724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6fd9a70dc3bc4cd5951a71219171835d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd9a70dc3bc4cd5951a71219171835d" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 44239 } } }
I20260808 07:09:26.618256 22724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:26.618417 22732 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:26.619104 22732 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:26.620755 22732 catalog_manager.cc:1347] Generated new cluster ID: efe572c46a1849c1a1d3e1d65393babb
I20260808 07:09:26.620811 22732 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:09:26 dist-test-slave-rmhg krb5kdc[22601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172966, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:09:26.624912 22721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:26.614538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48344 (local address 127.29.82.126:44239)
0808 07:09:26.614737 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:26.614747 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:26.614773 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:09:26.615228 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:26.615235 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:26.615284 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:26.615415 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:26.616048 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:26.617083 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:26.618210 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:26.618851 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:26.618953 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:26.622000 (+ 3047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:26.622005 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:26.622005 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:26.622018 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:26.623561 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:26.623883 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:26.623886 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:26.623886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:26.623967 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:26.624142 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:26.624143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:26.624143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:26.624376 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:26.624548 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:26.624619 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 07:09:26.624751 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":97,"threads_started":1}
I20260808 07:09:26.650069 22732 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:26.650858 22732 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:26.654817 22732 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d: Generated new TSK 0
I20260808 07:09:26.655019 22732 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:09:26.692361 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:44239
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:43999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:26.797773 22749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:26.797991 22749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:26.798015 22749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:26.799216 22749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:26.799260 22749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:26.799286 22749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:09:26.800804 22749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:43999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:44239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:26.801061 22749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:26.801314 22749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:26.806270 22758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:26.806265 22757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:26.806267 22761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:26.806514 22749 server_base.cc:1034] running on GCE node
I20260808 07:09:26.806716 22749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:26.806921 22749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:26.808094 22749 hybrid_clock.cc:648] HybridClock initialized: now 1786172966808077 us; error 34 us; skew 500 ppm
Aug 08 07:09:26 dist-test-slave-rmhg krb5kdc[22601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172966, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:26.810719 22749 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:09:26.811168 22749 webserver.cc:460] Webserver started at http://127.29.82.65:46345/ using document root <none> and password file <none>
I20260808 07:09:26.811391 22749 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:26.811441 22749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:26.811571 22749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:26.812634 22749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "cdf53e98485743d0b23e799f1748348b"
format_stamp: "Formatted at 2026-08-08 07:09:26 on dist-test-slave-rmhg"
server_key: "16fc4cc028e2fff098463809b452fdfb"
server_key_iv: "6ec932ce9390d701279118e845a88d40"
server_key_version: "encryptionkey@0"
I20260808 07:09:26.812985 22749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "cdf53e98485743d0b23e799f1748348b"
format_stamp: "Formatted at 2026-08-08 07:09:26 on dist-test-slave-rmhg"
server_key: "16fc4cc028e2fff098463809b452fdfb"
server_key_iv: "6ec932ce9390d701279118e845a88d40"
server_key_version: "encryptionkey@0"
I20260808 07:09:26.814332 22749 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:26.815078 22771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:26.815217 22749 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:26.815306 22749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "cdf53e98485743d0b23e799f1748348b"
format_stamp: "Formatted at 2026-08-08 07:09:26 on dist-test-slave-rmhg"
server_key: "16fc4cc028e2fff098463809b452fdfb"
server_key_iv: "6ec932ce9390d701279118e845a88d40"
server_key_version: "encryptionkey@0"
I20260808 07:09:26.815373 22749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:26.828069 22749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:26.830355 22749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:26.830505 22749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:26.830731 22749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:26.831046 22749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:26.831082 22749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:26.831113 22749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:26.831137 22749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:26.836792 22749 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:33081
I20260808 07:09:26.836863 22946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:33081 every 8 connection(s)
I20260808 07:09:26.837219 22749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:09:26.838279 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 22749
I20260808 07:09:26.838364 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:09:26.838572 30025 external_mini_cluster.cc:1428] Setting key 3cd666ea02c8d5dab26c12239e78d7d1
Aug 08 07:09:26 dist-test-slave-rmhg krb5kdc[22601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172966, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:09:26.846725 22721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:26.837924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:34717 (local address 127.29.82.126:44239)
0808 07:09:26.837986 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:26.837988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:26.838200 (+ 212us) server_negotiation.cc:407] Connection header received
0808 07:09:26.838778 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:26.838779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:26.838790 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:26.838844 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:26.839921 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:26.840598 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:26.841747 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:26.842063 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:26.842139 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:26.844133 (+ 1994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:26.844134 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:26.844134 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:26.844142 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:26.845427 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:26.845802 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:26.845803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:26.845804 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:26.845857 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:26.846088 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:26.846089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:26.846089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:26.846203 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:26.846261 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:26.846539 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 07:09:26.846632 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:09:26.846890 22950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:26.837897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:44239 (local address 127.29.82.65:34717)
0808 07:09:26.838065 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:26.838109 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:26.838647 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:26.838935 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:26.838939 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:26.839607 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:26.839815 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:26.839820 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:26.840694 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:26.840695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:26.841668 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:26.841671 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:26.842137 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:26.842137 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:26.842242 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:26.842741 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:26.842751 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:26.844042 (+ 1291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:26.845504 (+ 1462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:26.845512 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:26.845515 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:26.845735 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:26.845913 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:26.845914 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:26.845915 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:26.846028 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:26.846260 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:26.846267 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:26.846407 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 07:09:26.846505 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 07:09:26.846670 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
I20260808 07:09:26.847385 22947 heartbeater.cc:347] Connected to a master server at 127.29.82.126:44239
I20260808 07:09:26.847507 22947 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:26.847680 22947 heartbeater.cc:511] Master 127.29.82.126:44239 requested a full tablet report, sending...
I20260808 07:09:26.848246 22663 ts_manager.cc:194] Registered new tserver with Master: cdf53e98485743d0b23e799f1748348b (127.29.82.65:33081)
I20260808 07:09:26.848860 22663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:34717
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:09:26.863950 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:44239
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:43999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:26.948340 22954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:26.948570 22954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:26.948596 22954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:26.949855 22954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:26.949904 22954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:26.949931 22954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:09:26.951433 22954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:43999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:44239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:26.951647 22954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:26.951846 22954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:26.956809 22961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:26.956822 22963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:26.956809 22966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:26.957082 22954 server_base.cc:1034] running on GCE node
I20260808 07:09:26.957321 22954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:26.957531 22954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:26.958666 22954 hybrid_clock.cc:648] HybridClock initialized: now 1786172966958652 us; error 31 us; skew 500 ppm
Aug 08 07:09:26 dist-test-slave-rmhg krb5kdc[22601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172966, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:26.961210 22954 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:09:26.961688 22954 webserver.cc:460] Webserver started at http://127.29.82.66:41459/ using document root <none> and password file <none>
I20260808 07:09:26.961928 22954 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:26.961982 22954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:26.962095 22954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:26.963140 22954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "5537679c27d7418aa4495c3b7a8957fb"
format_stamp: "Formatted at 2026-08-08 07:09:26 on dist-test-slave-rmhg"
server_key: "85ef39c69c2120f36066249bfddfa420"
server_key_iv: "7ca6bc6e95d19ef8ec5761600ca4dd1a"
server_key_version: "encryptionkey@0"
I20260808 07:09:26.963467 22954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "5537679c27d7418aa4495c3b7a8957fb"
format_stamp: "Formatted at 2026-08-08 07:09:26 on dist-test-slave-rmhg"
server_key: "85ef39c69c2120f36066249bfddfa420"
server_key_iv: "7ca6bc6e95d19ef8ec5761600ca4dd1a"
server_key_version: "encryptionkey@0"
I20260808 07:09:26.964779 22954 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:09:26.965528 22973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:26.965672 22954 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:26.965754 22954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "5537679c27d7418aa4495c3b7a8957fb"
format_stamp: "Formatted at 2026-08-08 07:09:26 on dist-test-slave-rmhg"
server_key: "85ef39c69c2120f36066249bfddfa420"
server_key_iv: "7ca6bc6e95d19ef8ec5761600ca4dd1a"
server_key_version: "encryptionkey@0"
I20260808 07:09:26.965821 22954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:26.996457 22954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:26.998548 22954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:26.998687 22954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:26.998930 22954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:26.999264 22954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:26.999298 22954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:26.999320 22954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:26.999330 22954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:27.005311 22954 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:44753
I20260808 07:09:27.005363 23130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:44753 every 8 connection(s)
I20260808 07:09:27.005692 22954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:09:27.010025 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 22954
I20260808 07:09:27.010139 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:09:27.010380 30025 external_mini_cluster.cc:1428] Setting key afc513ecb60b0ad94a4c0eb1d7f58e0a
Aug 08 07:09:27 dist-test-slave-rmhg krb5kdc[22601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172966, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:09:27.015362 22721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.006447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:35199 (local address 127.29.82.126:44239)
0808 07:09:27.006512 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:27.006514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:27.006697 (+ 183us) server_negotiation.cc:407] Connection header received
0808 07:09:27.007189 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:27.007191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:27.007202 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:27.007266 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:27.008199 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.008732 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.009791 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.009980 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.010038 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.012590 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:27.012592 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:27.012592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:27.012600 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:27.013961 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:27.014449 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:27.014450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:27.014450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:27.014513 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:27.014721 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:27.014722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:27.014722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:27.014861 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:27.014931 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:27.015177 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 07:09:27.015270 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:09:27.015524 23134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.006404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:44239 (local address 127.29.82.66:35199)
0808 07:09:27.006568 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:27.006613 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:27.007101 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:27.007324 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:27.007327 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:27.007893 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:27.008120 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.008125 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.008816 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.008816 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.009718 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.009721 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.010066 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.010067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.010232 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.010853 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:27.010863 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:27.012492 (+ 1629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:27.014043 (+ 1551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:27.014053 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:27.014056 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:27.014364 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:27.014569 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:27.014569 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:27.014570 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:27.014670 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:27.014919 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:27.014922 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:27.015061 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 07:09:27.015140 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 07:09:27.015270 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
I20260808 07:09:27.016057 23132 heartbeater.cc:347] Connected to a master server at 127.29.82.126:44239
I20260808 07:09:27.016170 23132 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:27.016373 23132 heartbeater.cc:511] Master 127.29.82.126:44239 requested a full tablet report, sending...
I20260808 07:09:27.016794 22663 ts_manager.cc:194] Registered new tserver with Master: 5537679c27d7418aa4495c3b7a8957fb (127.29.82.66:44753)
I20260808 07:09:27.017376 22663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:35199
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:09:27.039247 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:44239
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:43999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:27.123618 23137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:27.123843 23137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:27.123867 23137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:27.125023 23137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:27.125062 23137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:27.125097 23137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:09:27.126606 23137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:43999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:44239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:27.126868 23137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:27.127095 23137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:27.132251 23145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:27.132248 23142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:27.132243 23143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:27.132372 23137 server_base.cc:1034] running on GCE node
I20260808 07:09:27.132680 23137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:27.132910 23137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:27.134063 23137 hybrid_clock.cc:648] HybridClock initialized: now 1786172967134043 us; error 35 us; skew 500 ppm
Aug 08 07:09:27 dist-test-slave-rmhg krb5kdc[22601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172967, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:27.136806 23137 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:09:27.137305 23137 webserver.cc:460] Webserver started at http://127.29.82.67:45017/ using document root <none> and password file <none>
I20260808 07:09:27.137589 23137 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:27.137645 23137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:27.137771 23137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:27.138829 23137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "304f85289dc9427ba98e8a9041b54077"
format_stamp: "Formatted at 2026-08-08 07:09:27 on dist-test-slave-rmhg"
server_key: "582b1ed84d9d71f9a7201d7be43fb6bd"
server_key_iv: "9c0c71d0a583d1212f76d3290ef7b14d"
server_key_version: "encryptionkey@0"
I20260808 07:09:27.139166 23137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "304f85289dc9427ba98e8a9041b54077"
format_stamp: "Formatted at 2026-08-08 07:09:27 on dist-test-slave-rmhg"
server_key: "582b1ed84d9d71f9a7201d7be43fb6bd"
server_key_iv: "9c0c71d0a583d1212f76d3290ef7b14d"
server_key_version: "encryptionkey@0"
I20260808 07:09:27.140564 23137 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:09:27.141335 23155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:27.141510 23137 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:27.141616 23137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "304f85289dc9427ba98e8a9041b54077"
format_stamp: "Formatted at 2026-08-08 07:09:27 on dist-test-slave-rmhg"
server_key: "582b1ed84d9d71f9a7201d7be43fb6bd"
server_key_iv: "9c0c71d0a583d1212f76d3290ef7b14d"
server_key_version: "encryptionkey@0"
I20260808 07:09:27.141680 23137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:27.155527 23137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:27.157801 23137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:27.157949 23137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:27.158181 23137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:27.158494 23137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:27.158529 23137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:27.158560 23137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:27.158583 23137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:27.164346 23137 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:43205
I20260808 07:09:27.164403 23312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:43205 every 8 connection(s)
I20260808 07:09:27.164745 23137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:09:27.165189 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 23137
I20260808 07:09:27.165275 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:09:27.165493 30025 external_mini_cluster.cc:1428] Setting key 720134f267b75bd38d0a3751ce159c97
Aug 08 07:09:27 dist-test-slave-rmhg krb5kdc[22601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172967, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:09:27.173993 22721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.165486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:55279 (local address 127.29.82.126:44239)
0808 07:09:27.165553 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:27.165556 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:27.165807 (+ 251us) server_negotiation.cc:407] Connection header received
0808 07:09:27.166416 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:27.166418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:27.166429 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:27.166462 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:27.167386 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.167906 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.169019 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.169293 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.169349 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.171547 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:27.171549 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:27.171549 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:27.171558 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:27.172683 (+ 1125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:27.173057 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:27.173058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:27.173059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:27.173110 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:27.173369 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:27.173370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:27.173370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:27.173484 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:27.173540 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:27.173815 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 07:09:27.173898 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:09:27.174177 23316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.165457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:44239 (local address 127.29.82.67:55279)
0808 07:09:27.165663 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:27.165716 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:27.166330 (+ 614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:27.166525 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:27.166529 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:27.167110 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:27.167312 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.167316 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.168012 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.168013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.168936 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.168940 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.169363 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.169364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.169505 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.170071 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:27.170080 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:27.171455 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:27.172761 (+ 1306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:27.172768 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:27.172770 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:27.172988 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:27.173184 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:27.173185 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:27.173185 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:27.173310 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:27.173541 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:27.173548 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:27.173692 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 07:09:27.173782 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 07:09:27.173951 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":86,"threads_started":1}
I20260808 07:09:27.174665 23313 heartbeater.cc:347] Connected to a master server at 127.29.82.126:44239
I20260808 07:09:27.174768 23313 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:27.174969 23313 heartbeater.cc:511] Master 127.29.82.126:44239 requested a full tablet report, sending...
I20260808 07:09:27.175344 22663 ts_manager.cc:194] Registered new tserver with Master: 304f85289dc9427ba98e8a9041b54077 (127.29.82.67:43205)
I20260808 07:09:27.175716 22663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:55279
I20260808 07:09:27.176996 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:09:27.183429 22721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.178350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48346 (local address 127.29.82.126:44239)
0808 07:09:27.178410 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:27.178412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:27.178482 (+ 70us) server_negotiation.cc:407] Connection header received
0808 07:09:27.178523 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:27.178523 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:27.178532 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:27.178580 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:27.179061 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.179525 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.180174 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.180340 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.180379 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.181496 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:27.181497 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:27.181497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:27.181503 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:27.182545 (+ 1042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:27.182827 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:27.182828 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:27.182828 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:27.182872 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:27.183012 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:27.183013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:27.183013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:27.183153 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:27.183227 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:27.183306 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 07:09:27.183362 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:09:27.184991 22663 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48346:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:09:27.186630 22663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:09:27.192917 23329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.188883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:44753 (local address 127.0.0.1:48634)
0808 07:09:27.189185 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:27.189196 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:27.189255 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:27.189420 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:27.189424 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:27.189426 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:27.189499 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.189501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.190584 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.190585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.191776 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.191779 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.192607 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.192608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.192691 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.192705 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 07:09:27.192785 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 07:09:27.192847 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":83,"threads_started":1}
I20260808 07:09:27.193269 23331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.189006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48634 (local address 127.29.82.66:44753)
0808 07:09:27.189198 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:27.189203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:27.189242 (+ 39us) server_negotiation.cc:407] Connection header received
0808 07:09:27.189318 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:27.189320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:27.189336 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:27.189400 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:27.189586 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.190490 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.191852 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.192531 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.192596 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.192662 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:27.193111 (+ 449us) server_negotiation.cc:299] Negotiation successful
0808 07:09:27.193184 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":72,"threads_started":1}
I20260808 07:09:27.193356 23330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.188882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:43205 (local address 127.0.0.1:53458)
0808 07:09:27.189020 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:27.189064 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:27.189125 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:27.189687 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:27.189688 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:27.189690 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:27.189747 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.189749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.191092 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.191093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.192062 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.192064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.193101 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.193102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.193197 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.193201 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:27.193248 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:09:27.193289 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":66,"threads_started":1}
I20260808 07:09:27.193418 23334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.189309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53458 (local address 127.29.82.67:43205)
0808 07:09:27.189483 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:27.189488 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:27.189499 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:09:27.189549 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:27.189551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:27.189567 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:27.189824 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:27.189900 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.190970 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.192143 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.192916 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.192992 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.193048 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:27.193282 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 07:09:27.193328 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260808 07:09:27.194046 23222 tablet_service.cc:1467] Processing CreateTablet for tablet c843767764bf4adbb2ce24fe1bc89529 (DEFAULT_TABLE table=test-table [id=22c7a9aca8964318b9fb57568613b817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:27.194026 23039 tablet_service.cc:1467] Processing CreateTablet for tablet c843767764bf4adbb2ce24fe1bc89529 (DEFAULT_TABLE table=test-table [id=22c7a9aca8964318b9fb57568613b817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:27.194432 23222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c843767764bf4adbb2ce24fe1bc89529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:27.194432 23039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c843767764bf4adbb2ce24fe1bc89529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:27.198141 23333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.189118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:33081 (local address 127.0.0.1:38322)
0808 07:09:27.189262 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:27.189271 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:27.189308 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:27.189950 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:27.189951 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:27.189953 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:27.190004 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.190005 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.191182 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.191183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.192162 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.192165 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.193501 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.193502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.193564 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.193568 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:27.193612 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:09:27.198046 (+ 4434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":113,"threads_started":1}
I20260808 07:09:27.198060 23337 tablet_bootstrap.cc:492] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077: Bootstrap starting.
I20260808 07:09:27.198513 23335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.189609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38322 (local address 127.29.82.65:33081)
0808 07:09:27.189800 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:27.189804 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:27.189813 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:09:27.189849 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:27.189851 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:27.189864 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:27.189941 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:27.190071 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.191103 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.192245 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.192916 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.192992 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.193250 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:27.198360 (+ 5110us) server_negotiation.cc:299] Negotiation successful
0808 07:09:27.198431 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":82,"threads_started":1}
I20260808 07:09:27.199100 23337 tablet_bootstrap.cc:654] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:27.199201 22837 tablet_service.cc:1467] Processing CreateTablet for tablet c843767764bf4adbb2ce24fe1bc89529 (DEFAULT_TABLE table=test-table [id=22c7a9aca8964318b9fb57568613b817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:27.199565 22837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c843767764bf4adbb2ce24fe1bc89529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:27.199658 23337 log.cc:824] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:27.200011 23338 tablet_bootstrap.cc:492] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb: Bootstrap starting.
I20260808 07:09:27.200441 23337 tablet_bootstrap.cc:492] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077: No bootstrap required, opened a new log
I20260808 07:09:27.200519 23337 ts_tablet_manager.cc:1397] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:09:27.200702 23338 tablet_bootstrap.cc:654] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:27.201242 23338 log.cc:824] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:27.201933 23338 tablet_bootstrap.cc:492] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb: No bootstrap required, opened a new log
I20260808 07:09:27.201999 23338 ts_tablet_manager.cc:1397] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:09:27.202693 23337 raft_consensus.cc:348] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5537679c27d7418aa4495c3b7a8957fb" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44753 } } peers { permanent_uuid: "304f85289dc9427ba98e8a9041b54077" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43205 } } peers { permanent_uuid: "cdf53e98485743d0b23e799f1748348b" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33081 } }
I20260808 07:09:27.202890 23337 raft_consensus.cc:374] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:27.202929 23337 raft_consensus.cc:729] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 304f85289dc9427ba98e8a9041b54077, State: Initialized, Role: FOLLOWER
I20260808 07:09:27.203203 23342 tablet_bootstrap.cc:492] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b: Bootstrap starting.
I20260808 07:09:27.203213 23337 consensus_queue.cc:260] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5537679c27d7418aa4495c3b7a8957fb" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44753 } } peers { permanent_uuid: "304f85289dc9427ba98e8a9041b54077" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43205 } } peers { permanent_uuid: "cdf53e98485743d0b23e799f1748348b" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33081 } }
I20260808 07:09:27.203542 23313 heartbeater.cc:503] Master 127.29.82.126:44239 was elected leader, sending a full tablet report...
I20260808 07:09:27.203548 23337 ts_tablet_manager.cc:1428] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:09:27.203663 23338 raft_consensus.cc:348] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5537679c27d7418aa4495c3b7a8957fb" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44753 } } peers { permanent_uuid: "304f85289dc9427ba98e8a9041b54077" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43205 } } peers { permanent_uuid: "cdf53e98485743d0b23e799f1748348b" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33081 } }
I20260808 07:09:27.203840 23338 raft_consensus.cc:374] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:27.203872 23338 raft_consensus.cc:729] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5537679c27d7418aa4495c3b7a8957fb, State: Initialized, Role: FOLLOWER
I20260808 07:09:27.204020 23342 tablet_bootstrap.cc:654] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:27.204011 23338 consensus_queue.cc:260] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5537679c27d7418aa4495c3b7a8957fb" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44753 } } peers { permanent_uuid: "304f85289dc9427ba98e8a9041b54077" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43205 } } peers { permanent_uuid: "cdf53e98485743d0b23e799f1748348b" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33081 } }
I20260808 07:09:27.204334 23338 ts_tablet_manager.cc:1428] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 07:09:27.204496 23132 heartbeater.cc:503] Master 127.29.82.126:44239 was elected leader, sending a full tablet report...
I20260808 07:09:27.204675 23342 log.cc:824] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:27.205817 23342 tablet_bootstrap.cc:492] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b: No bootstrap required, opened a new log
I20260808 07:09:27.205883 23342 ts_tablet_manager.cc:1397] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:09:27.207255 23342 raft_consensus.cc:348] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5537679c27d7418aa4495c3b7a8957fb" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44753 } } peers { permanent_uuid: "304f85289dc9427ba98e8a9041b54077" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43205 } } peers { permanent_uuid: "cdf53e98485743d0b23e799f1748348b" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33081 } }
I20260808 07:09:27.207401 23342 raft_consensus.cc:374] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:27.207422 23342 raft_consensus.cc:729] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdf53e98485743d0b23e799f1748348b, State: Initialized, Role: FOLLOWER
I20260808 07:09:27.207535 23342 consensus_queue.cc:260] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5537679c27d7418aa4495c3b7a8957fb" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44753 } } peers { permanent_uuid: "304f85289dc9427ba98e8a9041b54077" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43205 } } peers { permanent_uuid: "cdf53e98485743d0b23e799f1748348b" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33081 } }
I20260808 07:09:27.207805 23342 ts_tablet_manager.cc:1428] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:09:27.207826 22947 heartbeater.cc:503] Master 127.29.82.126:44239 was elected leader, sending a full tablet report...
W20260808 07:09:27.256321 23133 tablet.cc:2369] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:09:27.337945 22949 tablet.cc:2369] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:09:27.415298 23314 tablet.cc:2369] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:09:27.450474 23344 raft_consensus.cc:482] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:27.450620 23344 raft_consensus.cc:504] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5537679c27d7418aa4495c3b7a8957fb" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44753 } } peers { permanent_uuid: "304f85289dc9427ba98e8a9041b54077" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43205 } } peers { permanent_uuid: "cdf53e98485743d0b23e799f1748348b" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33081 } }
I20260808 07:09:27.450956 23344 leader_election.cc:288] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 304f85289dc9427ba98e8a9041b54077 (127.29.82.67:43205), cdf53e98485743d0b23e799f1748348b (127.29.82.65:33081)
I20260808 07:09:27.453817 23134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.451220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:43205 (local address 127.29.82.66:60119)
0808 07:09:27.451295 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:27.451310 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:27.451388 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:27.451525 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:27.451526 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:27.451528 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:27.451602 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.451604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.452233 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.452234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.452979 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.452981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.453571 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.453572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.453648 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.453651 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:09:27.453696 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:09:27.453739 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 07:09:27.453817 23334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.451268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:60119 (local address 127.29.82.67:43205)
0808 07:09:27.451318 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:27.451319 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:27.451372 (+ 53us) server_negotiation.cc:407] Connection header received
0808 07:09:27.451456 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:27.451457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:27.451467 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:27.451508 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:27.451665 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.452152 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.453076 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.453488 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.453554 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.453564 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:27.453713 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 07:09:27.453750 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:09:27.453941 23350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.451220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:33081 (local address 127.29.82.66:36441)
0808 07:09:27.451503 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:27.451512 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:27.451605 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:27.451745 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:27.451746 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:27.451748 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:27.451822 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.451824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.452420 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.452421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.453196 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.453198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.453695 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.453697 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.453770 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.453774 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:27.453817 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 07:09:27.453858 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":109,"thread_start_us":106,"threads_started":1}
I20260808 07:09:27.453931 23335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.451274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:36441 (local address 127.29.82.65:33081)
0808 07:09:27.451316 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:27.451317 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:27.451581 (+ 264us) server_negotiation.cc:407] Connection header received
0808 07:09:27.451672 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:27.451673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:27.451688 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:27.451729 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:27.451879 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.452342 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.453279 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.453628 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.453689 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.453697 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:27.453833 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 07:09:27.453867 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:09:27.454252 23250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c843767764bf4adbb2ce24fe1bc89529" candidate_uuid: "5537679c27d7418aa4495c3b7a8957fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "304f85289dc9427ba98e8a9041b54077" is_pre_election: true
I20260808 07:09:27.454309 22869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c843767764bf4adbb2ce24fe1bc89529" candidate_uuid: "5537679c27d7418aa4495c3b7a8957fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf53e98485743d0b23e799f1748348b" is_pre_election: true
I20260808 07:09:27.454407 23250 raft_consensus.cc:2454] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5537679c27d7418aa4495c3b7a8957fb in term 0.
I20260808 07:09:27.454442 22869 raft_consensus.cc:2454] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5537679c27d7418aa4495c3b7a8957fb in term 0.
I20260808 07:09:27.454645 22974 leader_election.cc:302] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 304f85289dc9427ba98e8a9041b54077, 5537679c27d7418aa4495c3b7a8957fb; no voters:
I20260808 07:09:27.454785 23344 raft_consensus.cc:2781] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:09:27.454846 23344 raft_consensus.cc:482] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:09:27.454869 23344 raft_consensus.cc:3037] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:27.455593 23344 raft_consensus.cc:504] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5537679c27d7418aa4495c3b7a8957fb" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44753 } } peers { permanent_uuid: "304f85289dc9427ba98e8a9041b54077" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43205 } } peers { permanent_uuid: "cdf53e98485743d0b23e799f1748348b" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33081 } }
I20260808 07:09:27.455726 23344 leader_election.cc:288] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [CANDIDATE]: Term 1 election: Requested vote from peers 304f85289dc9427ba98e8a9041b54077 (127.29.82.67:43205), cdf53e98485743d0b23e799f1748348b (127.29.82.65:33081)
I20260808 07:09:27.455895 22869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c843767764bf4adbb2ce24fe1bc89529" candidate_uuid: "5537679c27d7418aa4495c3b7a8957fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf53e98485743d0b23e799f1748348b"
I20260808 07:09:27.455964 22869 raft_consensus.cc:3037] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:27.456636 22869 raft_consensus.cc:2454] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5537679c27d7418aa4495c3b7a8957fb in term 1.
I20260808 07:09:27.456764 23250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c843767764bf4adbb2ce24fe1bc89529" candidate_uuid: "5537679c27d7418aa4495c3b7a8957fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "304f85289dc9427ba98e8a9041b54077"
I20260808 07:09:27.456800 22975 leader_election.cc:302] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5537679c27d7418aa4495c3b7a8957fb, cdf53e98485743d0b23e799f1748348b; no voters:
I20260808 07:09:27.456841 23250 raft_consensus.cc:3037] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:27.456926 23344 raft_consensus.cc:2781] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:27.457095 23344 raft_consensus.cc:686] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [term 1 LEADER]: Becoming Leader. State: Replica: 5537679c27d7418aa4495c3b7a8957fb, State: Running, Role: LEADER
I20260808 07:09:27.457218 23344 consensus_queue.cc:237] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5537679c27d7418aa4495c3b7a8957fb" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44753 } } peers { permanent_uuid: "304f85289dc9427ba98e8a9041b54077" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43205 } } peers { permanent_uuid: "cdf53e98485743d0b23e799f1748348b" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33081 } }
I20260808 07:09:27.457674 23250 raft_consensus.cc:2454] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5537679c27d7418aa4495c3b7a8957fb in term 1.
I20260808 07:09:27.458074 22662 catalog_manager.cc:5495] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 5537679c27d7418aa4495c3b7a8957fb (127.29.82.66). New cstate: current_term: 1 leader_uuid: "5537679c27d7418aa4495c3b7a8957fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5537679c27d7418aa4495c3b7a8957fb" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 44753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "304f85289dc9427ba98e8a9041b54077" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdf53e98485743d0b23e799f1748348b" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33081 } health_report { overall_health: UNKNOWN } } }
I20260808 07:09:27.475979 23331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.473809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48646 (local address 127.29.82.66:44753)
0808 07:09:27.473851 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:27.473854 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:27.473862 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:09:27.473921 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:27.473922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:27.473943 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:27.474006 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:09:27.474125 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.474617 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.475335 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.475551 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.475602 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.475707 (+ 105us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:09:27.475810 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:09:27.475866 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:27.475877 (+ 11us) server_negotiation.cc:299] Negotiation successful
0808 07:09:27.475896 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:09:27.477789 23250 raft_consensus.cc:1261] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077 [term 1 FOLLOWER]: Refusing update from remote peer 5537679c27d7418aa4495c3b7a8957fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:27.477826 22869 raft_consensus.cc:1261] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b [term 1 FOLLOWER]: Refusing update from remote peer 5537679c27d7418aa4495c3b7a8957fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:27.478165 23344 consensus_queue.cc:1035] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "304f85289dc9427ba98e8a9041b54077" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:27.478308 23351 consensus_queue.cc:1035] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf53e98485743d0b23e799f1748348b" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:27.480629 23355 mvcc.cc:205] Tried to move back new op lower bound from 7316164474786234368 to 7316164474705244160. Current Snapshot: MvccSnapshot[applied={T|T < 7316164474786234368}]
I20260808 07:09:27.481386 23357 mvcc.cc:205] Tried to move back new op lower bound from 7316164474786234368 to 7316164474705244160. Current Snapshot: MvccSnapshot[applied={T|T < 7316164474786234368 or (T in {7316164474786234368})}]
I20260808 07:09:27.483067 23358 mvcc.cc:205] Tried to move back new op lower bound from 7316164474786234368 to 7316164474705244160. Current Snapshot: MvccSnapshot[applied={T|T < 7316164474786234368 or (T in {7316164474786234368})}]
I20260808 07:09:27.483186 22662 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:27.483281 22662 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:27.484054 22662 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6fd9a70dc3bc4cd5951a71219171835d: Sending DeleteTablet for 3 replicas of tablet c843767764bf4adbb2ce24fe1bc89529
I20260808 07:09:27.484364 23039 tablet_service.cc:1514] Processing DeleteTablet for tablet c843767764bf4adbb2ce24fe1bc89529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:27 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:48634
I20260808 07:09:27.484381 23222 tablet_service.cc:1514] Processing DeleteTablet for tablet c843767764bf4adbb2ce24fe1bc89529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:27 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:53458
I20260808 07:09:27.484457 22837 tablet_service.cc:1514] Processing DeleteTablet for tablet c843767764bf4adbb2ce24fe1bc89529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:27 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:38322
I20260808 07:09:27.484668 23369 tablet_replica.cc:330] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b: stopping tablet replica
I20260808 07:09:27.484817 23369 raft_consensus.cc:2229] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:27.484733 23367 tablet_replica.cc:330] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb: stopping tablet replica
I20260808 07:09:27.484982 23369 raft_consensus.cc:2258] T c843767764bf4adbb2ce24fe1bc89529 P cdf53e98485743d0b23e799f1748348b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:27.484992 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 22749
I20260808 07:09:27.485015 23367 raft_consensus.cc:2229] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:09:27.487962 23367 raft_consensus.cc:2258] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:27.488458 23367 ts_tablet_manager.cc:1905] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:27.489288 23368 tablet_replica.cc:330] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077: stopping tablet replica
I20260808 07:09:27.489462 23368 raft_consensus.cc:2229] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:27.489638 23368 raft_consensus.cc:2258] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:27.490748 23367 ts_tablet_manager.cc:1918] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:27.490862 23367 log.cc:1196] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/c843767764bf4adbb2ce24fe1bc89529
I20260808 07:09:27.491099 23368 ts_tablet_manager.cc:1905] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:27.491153 23367 ts_tablet_manager.cc:1939] T c843767764bf4adbb2ce24fe1bc89529 P 5537679c27d7418aa4495c3b7a8957fb: Deleting consensus metadata
I20260808 07:09:27.492750 23368 ts_tablet_manager.cc:1918] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:27.492826 23368 log.cc:1196] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/c843767764bf4adbb2ce24fe1bc89529
I20260808 07:09:27.492985 22642 catalog_manager.cc:4841] TS 5537679c27d7418aa4495c3b7a8957fb (127.29.82.66:44753): tablet c843767764bf4adbb2ce24fe1bc89529 (table test-table [id=22c7a9aca8964318b9fb57568613b817]) successfully deleted
I20260808 07:09:27.493228 23368 ts_tablet_manager.cc:1939] T c843767764bf4adbb2ce24fe1bc89529 P 304f85289dc9427ba98e8a9041b54077: Deleting consensus metadata
I20260808 07:09:27.493673 22639 catalog_manager.cc:4841] TS 304f85289dc9427ba98e8a9041b54077 (127.29.82.67:43205): tablet c843767764bf4adbb2ce24fe1bc89529 (table test-table [id=22c7a9aca8964318b9fb57568613b817]) successfully deleted
W20260808 07:09:27.497013 22642 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:33081 (error 108)
I20260808 07:09:27.497639 23333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.497495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:33081 (local address 127.0.0.1:38324)
0808 07:09:27.497558 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:27.497605 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 07:09:27.497624 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 22954
W20260808 07:09:27.503067 22642 catalog_manager.cc:4584] TS cdf53e98485743d0b23e799f1748348b (127.29.82.65:33081): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c843767764bf4adbb2ce24fe1bc89529: Network error: Client connection negotiation failed: client connection to 127.29.82.65:33081: connect: Connection refused (error 111)
I20260808 07:09:27.507162 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 23137
I20260808 07:09:27.519182 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 22619
2026-08-08T07:09:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2303 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T07:09:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:27Z Disabled control of system clock
I20260808 07:09:27.554455 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:42249
--webserver_interface=127.29.82.126
--webserver_port=0
--builtin_ntp_servers=127.29.82.84:33967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:42249
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:09:27.637189 23374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:27.637419 23374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:27.637439 23374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:27.638583 23374 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:27.638620 23374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:27.638631 23374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:27.638644 23374 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:27.638655 23374 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:27.639971 23374 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:33967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:42249
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:42249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:27.640192 23374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:27.640452 23374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:27.645332 23385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:27.645359 23382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:27.645371 23381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:27.645450 23374 server_base.cc:1034] running on GCE node
I20260808 07:09:27.645860 23374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:27.646154 23374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:27.647320 23374 hybrid_clock.cc:648] HybridClock initialized: now 1786172967647299 us; error 41 us; skew 500 ppm
I20260808 07:09:27.648646 23374 webserver.cc:460] Webserver started at http://127.29.82.126:38289/ using document root <none> and password file <none>
I20260808 07:09:27.648893 23374 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:27.648944 23374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:27.649077 23374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:27.650177 23374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "9e1de870b8814bedac2ceeae60f1803e"
format_stamp: "Formatted at 2026-08-08 07:09:27 on dist-test-slave-rmhg"
server_key: "c9a274f6c6cbba6eec5e2667a300ba4b"
server_key_iv: "5b000328a40c70949a796c03a63ea181"
server_key_version: "encryptionkey@0"
I20260808 07:09:27.650519 23374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "9e1de870b8814bedac2ceeae60f1803e"
format_stamp: "Formatted at 2026-08-08 07:09:27 on dist-test-slave-rmhg"
server_key: "c9a274f6c6cbba6eec5e2667a300ba4b"
server_key_iv: "5b000328a40c70949a796c03a63ea181"
server_key_version: "encryptionkey@0"
I20260808 07:09:27.651818 23374 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:09:27.652493 23393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:27.652670 23374 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:27.652761 23374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "9e1de870b8814bedac2ceeae60f1803e"
format_stamp: "Formatted at 2026-08-08 07:09:27 on dist-test-slave-rmhg"
server_key: "c9a274f6c6cbba6eec5e2667a300ba4b"
server_key_iv: "5b000328a40c70949a796c03a63ea181"
server_key_version: "encryptionkey@0"
I20260808 07:09:27.652825 23374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:27.662043 23374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:27.662377 23374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:27.662566 23374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:27.666613 23374 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:42249
I20260808 07:09:27.666647 23466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:42249 every 8 connection(s)
I20260808 07:09:27.666994 23374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:27.668025 23467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:27.669389 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 23374
I20260808 07:09:27.669528 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:27.669752 30025 external_mini_cluster.cc:1428] Setting key e3885edcece19044c6740c4d892a9061
I20260808 07:09:27.670962 23467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e: Bootstrap starting.
I20260808 07:09:27.671657 23467 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:27.671940 23467 log.cc:824] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:27.672658 23467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e: No bootstrap required, opened a new log
I20260808 07:09:27.674832 23467 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e1de870b8814bedac2ceeae60f1803e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42249 } }
I20260808 07:09:27.674998 23467 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:27.675036 23467 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1de870b8814bedac2ceeae60f1803e, State: Initialized, Role: FOLLOWER
I20260808 07:09:27.675171 23467 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e1de870b8814bedac2ceeae60f1803e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42249 } }
I20260808 07:09:27.675257 23467 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:27.675295 23467 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:27.675341 23467 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:27.675792 23472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.670418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45858 (local address 127.29.82.126:42249)
0808 07:09:27.670689 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:27.670698 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:27.670724 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:09:27.671168 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:27.671176 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:27.671243 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:27.671366 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:27.671604 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.672697 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.673520 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.674191 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.674341 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.675046 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:27.675051 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:27.675052 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:27.675270 (+ 218us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:27.675316 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:27.675333 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:27.675398 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:27.675483 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 07:09:27.675567 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":94,"threads_started":1}
I20260808 07:09:27.676055 23467 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e1de870b8814bedac2ceeae60f1803e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42249 } }
I20260808 07:09:27.676162 23467 leader_election.cc:302] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e1de870b8814bedac2ceeae60f1803e; no voters:
I20260808 07:09:27.676327 23467 leader_election.cc:288] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:27.676371 23474 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:27.676535 23474 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [term 1 LEADER]: Becoming Leader. State: Replica: 9e1de870b8814bedac2ceeae60f1803e, State: Running, Role: LEADER
I20260808 07:09:27.676600 23467 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:27.676635 23474 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e1de870b8814bedac2ceeae60f1803e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42249 } }
I20260808 07:09:27.676944 23474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e1de870b8814bedac2ceeae60f1803e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e1de870b8814bedac2ceeae60f1803e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42249 } } }
I20260808 07:09:27.677093 23474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:27.677251 23475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e1de870b8814bedac2ceeae60f1803e. Latest consensus state: current_term: 1 leader_uuid: "9e1de870b8814bedac2ceeae60f1803e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e1de870b8814bedac2ceeae60f1803e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 42249 } } }
I20260808 07:09:27.677342 23475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:27.677618 23484 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:27.678159 23484 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:27.679848 23484 catalog_manager.cc:1347] Generated new cluster ID: af7f5f2960ee43c4bf809af175a93257
I20260808 07:09:27.679908 23484 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:27.689857 23484 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:27.690434 23484 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:27.692581 23484 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e: Generated new TSK 0
I20260808 07:09:27.692770 23484 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:27.699107 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:42249
--builtin_ntp_servers=127.29.82.84:33967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:09:27.783761 23497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:27.783985 23497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:27.784008 23497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:27.785401 23497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:27.785457 23497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:27.785485 23497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:09:27.786947 23497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:33967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:42249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:27.787197 23497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:27.787501 23497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:27.792678 23507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:27.792608 23503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:27.792613 23504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:27.792805 23497 server_base.cc:1034] running on GCE node
I20260808 07:09:27.793098 23497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:27.793421 23497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:27.794641 23497 hybrid_clock.cc:648] HybridClock initialized: now 1786172967794621 us; error 43 us; skew 500 ppm
I20260808 07:09:27.795975 23497 webserver.cc:460] Webserver started at http://127.29.82.65:45359/ using document root <none> and password file <none>
I20260808 07:09:27.796206 23497 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:27.796257 23497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:27.796387 23497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:27.797570 23497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "48f2c454547f45c9b33475478b462524"
format_stamp: "Formatted at 2026-08-08 07:09:27 on dist-test-slave-rmhg"
server_key: "8661cf3569bf52b9c781c14df9dc4d5a"
server_key_iv: "a524b22b5b05b3cda21aa2a7d733c936"
server_key_version: "encryptionkey@0"
I20260808 07:09:27.797916 23497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "48f2c454547f45c9b33475478b462524"
format_stamp: "Formatted at 2026-08-08 07:09:27 on dist-test-slave-rmhg"
server_key: "8661cf3569bf52b9c781c14df9dc4d5a"
server_key_iv: "a524b22b5b05b3cda21aa2a7d733c936"
server_key_version: "encryptionkey@0"
I20260808 07:09:27.799247 23497 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:27.800118 23516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:27.800323 23497 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:27.800422 23497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "48f2c454547f45c9b33475478b462524"
format_stamp: "Formatted at 2026-08-08 07:09:27 on dist-test-slave-rmhg"
server_key: "8661cf3569bf52b9c781c14df9dc4d5a"
server_key_iv: "a524b22b5b05b3cda21aa2a7d733c936"
server_key_version: "encryptionkey@0"
I20260808 07:09:27.800546 23497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:27.817417 23497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:27.817768 23497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:27.817914 23497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:27.818153 23497 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:27.818526 23497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:27.818563 23497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:27.818595 23497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:27.818612 23497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:27.824260 23497 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:35249
I20260808 07:09:27.824329 23679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:35249 every 8 connection(s)
I20260808 07:09:27.824684 23497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:09:27.825254 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 23497
I20260808 07:09:27.825356 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:09:27.825558 30025 external_mini_cluster.cc:1428] Setting key ac4be51f43957893edabeb67d3f66770
I20260808 07:09:27.826555 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:42249
--builtin_ntp_servers=127.29.82.84:33967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 07:09:27.830960 23472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.825458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:33371 (local address 127.29.82.126:42249)
0808 07:09:27.825534 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:27.825536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:27.825962 (+ 426us) server_negotiation.cc:407] Connection header received
0808 07:09:27.826523 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:27.826524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:27.826542 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:27.826614 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:27.827351 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.828020 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.829475 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.829665 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.829716 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.830685 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:27.830687 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:27.830687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:27.830692 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:27.830707 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:27.830711 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:27.830752 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:27.830874 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 07:09:27.830898 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 07:09:27.831239 23684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.825461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:42249 (local address 127.29.82.65:33371)
0808 07:09:27.825821 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:27.825866 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:27.826412 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:27.826700 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:27.826705 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:27.826718 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:27.827262 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.827267 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.828142 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.828143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.829379 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.829383 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.829748 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.829750 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.829912 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.830521 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:09:27.830522 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:27.830561 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:09:27.830590 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:27.830775 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:27.830790 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:27.830795 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:09:27.830879 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 07:09:27.831000 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":261,"threads_started":1}
I20260808 07:09:27.831789 23680 heartbeater.cc:347] Connected to a master server at 127.29.82.126:42249
I20260808 07:09:27.831899 23680 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:27.832114 23680 heartbeater.cc:511] Master 127.29.82.126:42249 requested a full tablet report, sending...
I20260808 07:09:27.832661 23422 ts_manager.cc:194] Registered new tserver with Master: 48f2c454547f45c9b33475478b462524 (127.29.82.65:35249)
I20260808 07:09:27.833346 23422 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.82.65:33371
W20260808 07:09:27.912668 23685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:27.912894 23685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:27.912915 23685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:27.914134 23685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:27.914179 23685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:27.914206 23685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:09:27.915565 23685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:33967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:42249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:27.915768 23685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:27.916051 23685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:27.921072 23691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:27.921044 23694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:27.921067 23692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:27.921253 23685 server_base.cc:1034] running on GCE node
I20260808 07:09:27.921548 23685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:27.921797 23685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:27.922940 23685 hybrid_clock.cc:648] HybridClock initialized: now 1786172967922931 us; error 35 us; skew 500 ppm
I20260808 07:09:27.924247 23685 webserver.cc:460] Webserver started at http://127.29.82.66:42627/ using document root <none> and password file <none>
I20260808 07:09:27.924517 23685 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:27.924582 23685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:27.924718 23685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:27.925848 23685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "cefb1345a8334fb5b8eb706b76b44ea2"
format_stamp: "Formatted at 2026-08-08 07:09:27 on dist-test-slave-rmhg"
server_key: "6eb0b562827dfa96c233b8dbc98e6dea"
server_key_iv: "ce29efa9b598f3f97ec19aeaf5a53c44"
server_key_version: "encryptionkey@0"
I20260808 07:09:27.926195 23685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "cefb1345a8334fb5b8eb706b76b44ea2"
format_stamp: "Formatted at 2026-08-08 07:09:27 on dist-test-slave-rmhg"
server_key: "6eb0b562827dfa96c233b8dbc98e6dea"
server_key_iv: "ce29efa9b598f3f97ec19aeaf5a53c44"
server_key_version: "encryptionkey@0"
I20260808 07:09:27.927491 23685 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:09:27.928308 23704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:27.928536 23685 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:27.928637 23685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "cefb1345a8334fb5b8eb706b76b44ea2"
format_stamp: "Formatted at 2026-08-08 07:09:27 on dist-test-slave-rmhg"
server_key: "6eb0b562827dfa96c233b8dbc98e6dea"
server_key_iv: "ce29efa9b598f3f97ec19aeaf5a53c44"
server_key_version: "encryptionkey@0"
I20260808 07:09:27.928707 23685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:27.946130 23685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:27.946480 23685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:27.946624 23685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:27.946884 23685 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:27.947243 23685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:27.947281 23685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:27.947312 23685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:27.947335 23685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:27.952889 23685 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:32903
I20260808 07:09:27.952940 23867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:32903 every 8 connection(s)
I20260808 07:09:27.953334 23685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:09:27.958652 23472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.954173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:40021 (local address 127.29.82.126:42249)
0808 07:09:27.954274 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:27.954276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:27.954462 (+ 186us) server_negotiation.cc:407] Connection header received
0808 07:09:27.954946 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:27.954947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:27.954956 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:27.955028 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:27.955738 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.956287 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.957397 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.957598 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.957661 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.958438 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:27.958439 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:27.958439 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:27.958443 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:27.958457 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:27.958461 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:27.958500 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:27.958564 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 07:09:27.958587 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 07:09:27.958839 23871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:27.954112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:42249 (local address 127.29.82.66:40021)
0808 07:09:27.954337 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:27.954379 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:27.954855 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:27.955095 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:27.955099 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:27.955108 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:27.955668 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.955673 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.956403 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.956405 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.957293 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:27.957296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:27.957676 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:27.957677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:27.957791 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:27.958308 (+ 517us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:09:27.958308 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:27.958339 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:09:27.958363 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:27.958512 (+ 149us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:27.958514 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:27.958516 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:09:27.958560 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:09:27.958644 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":95,"threads_started":1}
I20260808 07:09:27.959277 23868 heartbeater.cc:347] Connected to a master server at 127.29.82.126:42249
I20260808 07:09:27.959368 23868 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:27.959561 23868 heartbeater.cc:511] Master 127.29.82.126:42249 requested a full tablet report, sending...
I20260808 07:09:27.959926 23422 ts_manager.cc:194] Registered new tserver with Master: cefb1345a8334fb5b8eb706b76b44ea2 (127.29.82.66:32903)
I20260808 07:09:27.960287 23422 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.82.66:40021
I20260808 07:09:27.963158 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 23685
I20260808 07:09:27.963253 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:09:27.963431 30025 external_mini_cluster.cc:1428] Setting key 449a9f48a857d0bce81992f1e3a447c0
I20260808 07:09:27.964399 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:42249
--builtin_ntp_servers=127.29.82.84:33967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:09:28.048313 23872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:28.048533 23872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:28.048578 23872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:28.049839 23872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:28.049882 23872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:28.049916 23872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:09:28.051295 23872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:33967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:42249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:28.051548 23872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:28.051849 23872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:28.056928 23880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:28.056989 23884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:28.056928 23881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:28.057324 23872 server_base.cc:1034] running on GCE node
I20260808 07:09:28.057533 23872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:28.057768 23872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:28.058923 23872 hybrid_clock.cc:648] HybridClock initialized: now 1786172968058907 us; error 30 us; skew 500 ppm
I20260808 07:09:28.060215 23872 webserver.cc:460] Webserver started at http://127.29.82.67:39027/ using document root <none> and password file <none>
I20260808 07:09:28.060448 23872 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:28.060498 23872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:28.060634 23872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:28.061784 23872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "23c47c727ab04efca505d5d531573161"
format_stamp: "Formatted at 2026-08-08 07:09:28 on dist-test-slave-rmhg"
server_key: "73f1757da5f2dd8d25161be946c95e16"
server_key_iv: "d7898be1c87c21fa57bdc2465dd34631"
server_key_version: "encryptionkey@0"
I20260808 07:09:28.062127 23872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "23c47c727ab04efca505d5d531573161"
format_stamp: "Formatted at 2026-08-08 07:09:28 on dist-test-slave-rmhg"
server_key: "73f1757da5f2dd8d25161be946c95e16"
server_key_iv: "d7898be1c87c21fa57bdc2465dd34631"
server_key_version: "encryptionkey@0"
I20260808 07:09:28.063373 23872 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:09:28.064031 23891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:28.064175 23872 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:28.064265 23872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "23c47c727ab04efca505d5d531573161"
format_stamp: "Formatted at 2026-08-08 07:09:28 on dist-test-slave-rmhg"
server_key: "73f1757da5f2dd8d25161be946c95e16"
server_key_iv: "d7898be1c87c21fa57bdc2465dd34631"
server_key_version: "encryptionkey@0"
I20260808 07:09:28.064327 23872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:28.079963 23872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:28.080317 23872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:28.080462 23872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:28.080715 23872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:28.081066 23872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:28.081101 23872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:28.081141 23872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:28.081188 23872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:28.086759 23872 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:45861
I20260808 07:09:28.086810 24069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:45861 every 8 connection(s)
I20260808 07:09:28.087162 23872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:09:28.090426 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 23872
I20260808 07:09:28.090540 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:09:28.090751 30025 external_mini_cluster.cc:1428] Setting key 59db5f578fd8f7a70f3c31c36ce3743c
I20260808 07:09:28.092898 23472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.087893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:55287 (local address 127.29.82.126:42249)
0808 07:09:28.087982 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:28.087985 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:28.088171 (+ 186us) server_negotiation.cc:407] Connection header received
0808 07:09:28.088716 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:28.088717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:28.088730 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:28.088800 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:28.089517 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.090043 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.091564 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.091761 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.091817 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:28.092633 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:28.092634 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:28.092635 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:28.092640 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:28.092657 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:28.092661 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:28.092704 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:28.092785 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 07:09:28.092814 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 07:09:28.093106 24073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.087868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:42249 (local address 127.29.82.67:55287)
0808 07:09:28.088052 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:28.088087 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:28.088597 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:28.088857 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:28.088860 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:28.088869 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:28.089433 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:28.089438 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.090151 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.090152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:28.091489 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:28.091492 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.091836 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.091837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:28.091981 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:28.092495 (+ 514us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:09:28.092496 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:28.092527 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:09:28.092551 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:28.092711 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:28.092717 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:28.092720 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:09:28.092780 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 07:09:28.092888 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260808 07:09:28.093559 24070 heartbeater.cc:347] Connected to a master server at 127.29.82.126:42249
I20260808 07:09:28.093660 24070 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:28.093844 24070 heartbeater.cc:511] Master 127.29.82.126:42249 requested a full tablet report, sending...
I20260808 07:09:28.094167 23422 ts_manager.cc:194] Registered new tserver with Master: 23c47c727ab04efca505d5d531573161 (127.29.82.67:45861)
I20260808 07:09:28.094507 23422 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.82.67:55287
I20260808 07:09:28.102676 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:09:28.107043 23472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.104077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45868 (local address 127.29.82.126:42249)
0808 07:09:28.104169 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:28.104171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:28.104279 (+ 108us) server_negotiation.cc:407] Connection header received
0808 07:09:28.104351 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:28.104352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:28.104362 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:28.104410 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:28.104636 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.105136 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.105899 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.106100 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.106155 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:28.106792 (+ 637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:28.106794 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:28.106794 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:28.106799 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:28.106816 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:28.106819 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:28.106861 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:28.106920 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 07:09:28.106945 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 07:09:28.108534 23422 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45868:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:09:28.110152 23422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:09:28.116510 24082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.112356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:35249 (local address 127.0.0.1:50174)
0808 07:09:28.112671 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:28.112716 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:28.112782 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:28.113022 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:28.113025 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:28.113028 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:28.113102 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:28.113104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.114472 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.114472 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:28.115522 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:28.115524 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.116203 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.116204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:28.116286 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:28.116300 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 07:09:28.116365 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 07:09:28.116419 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":83,"threads_started":1}
I20260808 07:09:28.116628 24081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.112357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:32903 (local address 127.0.0.1:51888)
0808 07:09:28.112694 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:28.112723 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:28.112780 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:28.113124 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:28.113125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:28.113127 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:28.113208 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:28.113210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.114209 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.114210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:28.115475 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:28.115477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.116356 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.116357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:28.116409 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:28.116412 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:09:28.116457 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:09:28.116489 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":24,"spinlock_wait_cycles":896,"thread_start_us":118,"threads_started":1}
I20260808 07:09:28.116735 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.112458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51888 (local address 127.29.82.66:32903)
0808 07:09:28.112974 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:28.112979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:28.112988 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:09:28.113023 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:28.113025 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:28.113038 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:28.113123 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:28.113287 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.114124 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.115545 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.116246 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.116348 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:28.116425 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:28.116481 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 07:09:28.116519 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":141,"threads_started":1}
I20260808 07:09:28.116806 24083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.112462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50174 (local address 127.29.82.65:35249)
0808 07:09:28.112646 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:28.112651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:28.112859 (+ 208us) server_negotiation.cc:407] Connection header received
0808 07:09:28.112908 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:28.112910 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:28.112928 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:28.113003 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:28.113214 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.114369 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.115616 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.116118 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.116187 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:28.116290 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:28.116662 (+ 372us) server_negotiation.cc:299] Negotiation successful
0808 07:09:28.116707 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":83,"threads_started":1}
I20260808 07:09:28.116912 24087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.112817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43718 (local address 127.29.82.67:45861)
0808 07:09:28.112983 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:28.112987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:28.112995 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:09:28.113034 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:28.113035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:28.113050 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:28.113295 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:28.113469 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.114525 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.115510 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.116242 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.116313 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:28.116405 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:28.116785 (+ 380us) server_negotiation.cc:299] Negotiation successful
0808 07:09:28.116831 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":90,"threads_started":1}
I20260808 07:09:28.117491 23773 tablet_service.cc:1467] Processing CreateTablet for tablet 43a9a66b4e9f4c2889bcf7f0df7494fe (DEFAULT_TABLE table=test-table [id=e3a64ea9cc8b486e874f93fe04154114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:28.117532 23587 tablet_service.cc:1467] Processing CreateTablet for tablet 43a9a66b4e9f4c2889bcf7f0df7494fe (DEFAULT_TABLE table=test-table [id=e3a64ea9cc8b486e874f93fe04154114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:28.117875 23773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43a9a66b4e9f4c2889bcf7f0df7494fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:28.117892 23587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43a9a66b4e9f4c2889bcf7f0df7494fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:28.120337 24089 tablet_bootstrap.cc:492] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2: Bootstrap starting.
I20260808 07:09:28.120438 24088 tablet_bootstrap.cc:492] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524: Bootstrap starting.
I20260808 07:09:28.120756 24086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.112599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:45861 (local address 127.0.0.1:43718)
0808 07:09:28.112817 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:28.112825 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:28.112863 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:28.113355 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:28.113356 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:28.113358 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:28.113395 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:28.113396 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.114600 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.114601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:28.115441 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:28.115443 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.116441 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.116443 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:28.116515 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:28.116520 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:09:28.116574 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 07:09:28.120675 (+ 4101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":70,"threads_started":1}
I20260808 07:09:28.121196 24089 tablet_bootstrap.cc:654] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:28.121202 24088 tablet_bootstrap.cc:654] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:28.121480 24089 log.cc:824] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:28.121502 24088 log.cc:824] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:28.121559 23962 tablet_service.cc:1467] Processing CreateTablet for tablet 43a9a66b4e9f4c2889bcf7f0df7494fe (DEFAULT_TABLE table=test-table [id=e3a64ea9cc8b486e874f93fe04154114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:28.121924 23962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43a9a66b4e9f4c2889bcf7f0df7494fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:28.122217 24088 tablet_bootstrap.cc:492] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524: No bootstrap required, opened a new log
I20260808 07:09:28.122217 24089 tablet_bootstrap.cc:492] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2: No bootstrap required, opened a new log
I20260808 07:09:28.122289 24089 ts_tablet_manager.cc:1397] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:09:28.122289 24088 ts_tablet_manager.cc:1397] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:09:28.124522 24093 tablet_bootstrap.cc:492] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161: Bootstrap starting.
I20260808 07:09:28.124832 24089 raft_consensus.cc:348] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f2c454547f45c9b33475478b462524" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 35249 } } peers { permanent_uuid: "cefb1345a8334fb5b8eb706b76b44ea2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32903 } } peers { permanent_uuid: "23c47c727ab04efca505d5d531573161" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 45861 } }
I20260808 07:09:28.124821 24088 raft_consensus.cc:348] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f2c454547f45c9b33475478b462524" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 35249 } } peers { permanent_uuid: "cefb1345a8334fb5b8eb706b76b44ea2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32903 } } peers { permanent_uuid: "23c47c727ab04efca505d5d531573161" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 45861 } }
I20260808 07:09:28.124995 24088 raft_consensus.cc:374] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:28.125005 24089 raft_consensus.cc:374] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:28.125032 24088 raft_consensus.cc:729] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f2c454547f45c9b33475478b462524, State: Initialized, Role: FOLLOWER
I20260808 07:09:28.125038 24089 raft_consensus.cc:729] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cefb1345a8334fb5b8eb706b76b44ea2, State: Initialized, Role: FOLLOWER
I20260808 07:09:28.125102 24093 tablet_bootstrap.cc:654] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:28.125202 24089 consensus_queue.cc:260] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f2c454547f45c9b33475478b462524" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 35249 } } peers { permanent_uuid: "cefb1345a8334fb5b8eb706b76b44ea2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32903 } } peers { permanent_uuid: "23c47c727ab04efca505d5d531573161" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 45861 } }
I20260808 07:09:28.125455 24093 log.cc:824] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:28.125495 24089 ts_tablet_manager.cc:1428] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 07:09:28.125548 23868 heartbeater.cc:503] Master 127.29.82.126:42249 was elected leader, sending a full tablet report...
I20260808 07:09:28.125428 24088 consensus_queue.cc:260] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f2c454547f45c9b33475478b462524" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 35249 } } peers { permanent_uuid: "cefb1345a8334fb5b8eb706b76b44ea2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32903 } } peers { permanent_uuid: "23c47c727ab04efca505d5d531573161" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 45861 } }
I20260808 07:09:28.125797 24088 ts_tablet_manager.cc:1428] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 07:09:28.125891 23680 heartbeater.cc:503] Master 127.29.82.126:42249 was elected leader, sending a full tablet report...
I20260808 07:09:28.126243 24093 tablet_bootstrap.cc:492] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161: No bootstrap required, opened a new log
I20260808 07:09:28.126319 24093 ts_tablet_manager.cc:1397] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:09:28.128299 24093 raft_consensus.cc:348] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f2c454547f45c9b33475478b462524" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 35249 } } peers { permanent_uuid: "cefb1345a8334fb5b8eb706b76b44ea2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32903 } } peers { permanent_uuid: "23c47c727ab04efca505d5d531573161" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 45861 } }
I20260808 07:09:28.128430 24093 raft_consensus.cc:374] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:28.128450 24093 raft_consensus.cc:729] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23c47c727ab04efca505d5d531573161, State: Initialized, Role: FOLLOWER
I20260808 07:09:28.128549 24093 consensus_queue.cc:260] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f2c454547f45c9b33475478b462524" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 35249 } } peers { permanent_uuid: "cefb1345a8334fb5b8eb706b76b44ea2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32903 } } peers { permanent_uuid: "23c47c727ab04efca505d5d531573161" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 45861 } }
I20260808 07:09:28.128784 24093 ts_tablet_manager.cc:1428] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:09:28.128856 24070 heartbeater.cc:503] Master 127.29.82.126:42249 was elected leader, sending a full tablet report...
I20260808 07:09:28.199203 24098 raft_consensus.cc:482] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:28.199353 24098 raft_consensus.cc:504] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f2c454547f45c9b33475478b462524" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 35249 } } peers { permanent_uuid: "cefb1345a8334fb5b8eb706b76b44ea2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32903 } } peers { permanent_uuid: "23c47c727ab04efca505d5d531573161" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 45861 } }
I20260808 07:09:28.199747 24098 leader_election.cc:288] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48f2c454547f45c9b33475478b462524 (127.29.82.65:35249), cefb1345a8334fb5b8eb706b76b44ea2 (127.29.82.66:32903)
I20260808 07:09:28.203661 24083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.200008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:57109 (local address 127.29.82.65:35249)
0808 07:09:28.200057 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:28.200060 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:28.200210 (+ 150us) server_negotiation.cc:407] Connection header received
0808 07:09:28.200238 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:28.200240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:28.200252 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:28.200297 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:28.200420 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.201137 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.202651 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.203249 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.203312 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:28.203321 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:28.203541 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 07:09:28.203583 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:09:28.203661 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.200069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:58003 (local address 127.29.82.66:32903)
0808 07:09:28.200110 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:28.200112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:28.200121 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:09:28.200150 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:28.200150 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:28.200158 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:28.200213 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:28.200369 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.201143 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.202657 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.203235 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.203312 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:28.203321 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:28.203549 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 07:09:28.203584 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:09:28.203675 24073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.199934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:32903 (local address 127.29.82.67:58003)
0808 07:09:28.199983 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:28.199996 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:28.200044 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:28.200227 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:28.200228 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:28.200230 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:28.200299 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:28.200302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.201241 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.201242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:28.202570 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:28.202574 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.203340 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.203341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:28.203485 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:28.203488 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:09:28.203536 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 07:09:28.203574 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":36}
I20260808 07:09:28.203685 24100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.199937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:35249 (local address 127.29.82.67:57109)
0808 07:09:28.200147 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:28.200155 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:28.200196 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:28.200306 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:28.200307 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:28.200308 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:28.200360 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:28.200361 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.201240 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.201242 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:28.202570 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:28.202574 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.203340 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.203341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:28.203448 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:28.203455 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 07:09:28.203524 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 07:09:28.203574 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":138,"thread_start_us":99,"threads_started":1}
W20260808 07:09:28.203908 23869 tablet.cc:2369] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:09:28.204020 23615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43a9a66b4e9f4c2889bcf7f0df7494fe" candidate_uuid: "23c47c727ab04efca505d5d531573161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f2c454547f45c9b33475478b462524" is_pre_election: true
I20260808 07:09:28.204195 23615 raft_consensus.cc:2454] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23c47c727ab04efca505d5d531573161 in term 0.
I20260808 07:09:28.204448 23894 leader_election.cc:302] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23c47c727ab04efca505d5d531573161, 48f2c454547f45c9b33475478b462524; no voters:
I20260808 07:09:28.204449 23801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43a9a66b4e9f4c2889bcf7f0df7494fe" candidate_uuid: "23c47c727ab04efca505d5d531573161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cefb1345a8334fb5b8eb706b76b44ea2" is_pre_election: true
I20260808 07:09:28.204566 23801 raft_consensus.cc:2454] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23c47c727ab04efca505d5d531573161 in term 0.
I20260808 07:09:28.204574 24098 raft_consensus.cc:2781] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:09:28.204627 24098 raft_consensus.cc:482] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:09:28.204655 24098 raft_consensus.cc:3037] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:28.205438 24098 raft_consensus.cc:504] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f2c454547f45c9b33475478b462524" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 35249 } } peers { permanent_uuid: "cefb1345a8334fb5b8eb706b76b44ea2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32903 } } peers { permanent_uuid: "23c47c727ab04efca505d5d531573161" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 45861 } }
I20260808 07:09:28.205562 24098 leader_election.cc:288] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [CANDIDATE]: Term 1 election: Requested vote from peers 48f2c454547f45c9b33475478b462524 (127.29.82.65:35249), cefb1345a8334fb5b8eb706b76b44ea2 (127.29.82.66:32903)
I20260808 07:09:28.205747 23615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43a9a66b4e9f4c2889bcf7f0df7494fe" candidate_uuid: "23c47c727ab04efca505d5d531573161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f2c454547f45c9b33475478b462524"
I20260808 07:09:28.205755 23801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43a9a66b4e9f4c2889bcf7f0df7494fe" candidate_uuid: "23c47c727ab04efca505d5d531573161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cefb1345a8334fb5b8eb706b76b44ea2"
I20260808 07:09:28.205819 23801 raft_consensus.cc:3037] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:28.205823 23615 raft_consensus.cc:3037] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:28.206506 23801 raft_consensus.cc:2454] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23c47c727ab04efca505d5d531573161 in term 1.
I20260808 07:09:28.206597 23615 raft_consensus.cc:2454] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23c47c727ab04efca505d5d531573161 in term 1.
I20260808 07:09:28.206758 23894 leader_election.cc:302] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23c47c727ab04efca505d5d531573161, 48f2c454547f45c9b33475478b462524; no voters:
I20260808 07:09:28.206872 24098 raft_consensus.cc:2781] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:28.207029 24098 raft_consensus.cc:686] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [term 1 LEADER]: Becoming Leader. State: Replica: 23c47c727ab04efca505d5d531573161, State: Running, Role: LEADER
I20260808 07:09:28.207114 24098 consensus_queue.cc:237] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f2c454547f45c9b33475478b462524" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 35249 } } peers { permanent_uuid: "cefb1345a8334fb5b8eb706b76b44ea2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32903 } } peers { permanent_uuid: "23c47c727ab04efca505d5d531573161" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 45861 } }
I20260808 07:09:28.207897 23422 catalog_manager.cc:5495] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23c47c727ab04efca505d5d531573161 (127.29.82.67). New cstate: current_term: 1 leader_uuid: "23c47c727ab04efca505d5d531573161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48f2c454547f45c9b33475478b462524" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cefb1345a8334fb5b8eb706b76b44ea2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23c47c727ab04efca505d5d531573161" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 45861 } health_report { overall_health: HEALTHY } } }
I20260808 07:09:28.235925 24087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.233669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43734 (local address 127.29.82.67:45861)
0808 07:09:28.233717 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:28.233718 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:28.233726 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:09:28.233786 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:28.233787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:28.233806 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:28.233867 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:09:28.234042 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.234592 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.235303 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:28.235484 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:28.235527 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:28.235634 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:09:28.235738 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:09:28.235796 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:28.235808 (+ 12us) server_negotiation.cc:299] Negotiation successful
0808 07:09:28.235823 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:09:28.237840 23615 raft_consensus.cc:1261] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524 [term 1 FOLLOWER]: Refusing update from remote peer 23c47c727ab04efca505d5d531573161: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:28.237841 23801 raft_consensus.cc:1261] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2 [term 1 FOLLOWER]: Refusing update from remote peer 23c47c727ab04efca505d5d531573161: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:28.238211 24098 consensus_queue.cc:1035] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f2c454547f45c9b33475478b462524" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:28.238363 24102 consensus_queue.cc:1035] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cefb1345a8334fb5b8eb706b76b44ea2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:28.240746 24108 mvcc.cc:205] Tried to move back new op lower bound from 7316164477899399168 to 7316164477777104896. Current Snapshot: MvccSnapshot[applied={T|T < 7316164477899399168}]
I20260808 07:09:28.240985 24111 mvcc.cc:205] Tried to move back new op lower bound from 7316164477899399168 to 7316164477777104896. Current Snapshot: MvccSnapshot[applied={T|T < 7316164477899399168}]
I20260808 07:09:28.241129 24109 mvcc.cc:205] Tried to move back new op lower bound from 7316164477899399168 to 7316164477777104896. Current Snapshot: MvccSnapshot[applied={T|T < 7316164477899399168}]
I20260808 07:09:28.243719 23420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:28.243808 23420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:28.244588 23420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9e1de870b8814bedac2ceeae60f1803e: Sending DeleteTablet for 3 replicas of tablet 43a9a66b4e9f4c2889bcf7f0df7494fe
I20260808 07:09:28.244935 23962 tablet_service.cc:1514] Processing DeleteTablet for tablet 43a9a66b4e9f4c2889bcf7f0df7494fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:28 UTC) from {username='slave'} at 127.0.0.1:43718
I20260808 07:09:28.244939 23587 tablet_service.cc:1514] Processing DeleteTablet for tablet 43a9a66b4e9f4c2889bcf7f0df7494fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:28 UTC) from {username='slave'} at 127.0.0.1:50174
I20260808 07:09:28.245008 23773 tablet_service.cc:1514] Processing DeleteTablet for tablet 43a9a66b4e9f4c2889bcf7f0df7494fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:28 UTC) from {username='slave'} at 127.0.0.1:51888
I20260808 07:09:28.245230 24126 tablet_replica.cc:330] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524: stopping tablet replica
I20260808 07:09:28.245343 24126 raft_consensus.cc:2229] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 48f2c454547f45c9b33475478b462524 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:28.245414 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 23497
I20260808 07:09:28.245471 24128 tablet_replica.cc:330] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2: stopping tablet replica
I20260808 07:09:28.255059 24127 tablet_replica.cc:330] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161: stopping tablet replica
I20260808 07:09:28.255201 24127 raft_consensus.cc:2229] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:09:28.255357 24127 raft_consensus.cc:2258] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:28.259476 24127 ts_tablet_manager.cc:1905] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:28.259479 24128 raft_consensus.cc:2229] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:28.259650 24128 raft_consensus.cc:2258] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:28.260157 24128 ts_tablet_manager.cc:1905] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:28.261247 24127 ts_tablet_manager.cc:1918] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:28.261395 24127 log.cc:1196] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/43a9a66b4e9f4c2889bcf7f0df7494fe
I20260808 07:09:28.261761 24127 ts_tablet_manager.cc:1939] T 43a9a66b4e9f4c2889bcf7f0df7494fe P 23c47c727ab04efca505d5d531573161: Deleting consensus metadata
I20260808 07:09:28.261873 24128 ts_tablet_manager.cc:1918] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:28.261976 24128 log.cc:1196] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/43a9a66b4e9f4c2889bcf7f0df7494fe
I20260808 07:09:28.262233 24128 ts_tablet_manager.cc:1939] T 43a9a66b4e9f4c2889bcf7f0df7494fe P cefb1345a8334fb5b8eb706b76b44ea2: Deleting consensus metadata
I20260808 07:09:28.262473 23401 catalog_manager.cc:4841] TS 23c47c727ab04efca505d5d531573161 (127.29.82.67:45861): tablet 43a9a66b4e9f4c2889bcf7f0df7494fe (table test-table [id=e3a64ea9cc8b486e874f93fe04154114]) successfully deleted
I20260808 07:09:28.262674 23401 catalog_manager.cc:4841] TS cefb1345a8334fb5b8eb706b76b44ea2 (127.29.82.66:32903): tablet 43a9a66b4e9f4c2889bcf7f0df7494fe (table test-table [id=e3a64ea9cc8b486e874f93fe04154114]) successfully deleted
W20260808 07:09:28.264971 23399 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:35249 (error 108)
I20260808 07:09:28.265506 24086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:28.265378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:35249 (local address 127.0.0.1:50180)
0808 07:09:28.265431 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:28.265475 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:35249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 07:09:28.265626 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 23685
W20260808 07:09:28.275877 23399 catalog_manager.cc:4584] TS 48f2c454547f45c9b33475478b462524 (127.29.82.65:35249): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 43a9a66b4e9f4c2889bcf7f0df7494fe: Network error: Client connection negotiation failed: client connection to 127.29.82.65:35249: connect: Connection refused (error 111)
I20260808 07:09:28.281335 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 23872
I20260808 07:09:28.293769 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 23374
2026-08-08T07:09:28Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (775 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:28 dist-test-slave-rmhg krb5kdc[24135](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:28 dist-test-slave-rmhg krb5kdc[24135](info): set up 2 sockets
Aug 08 07:09:28 dist-test-slave-rmhg krb5kdc[24135](info): commencing operation
krb5kdc: starting...
W20260808 07:09:29.419757 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:29 dist-test-slave-rmhg krb5kdc[24135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172969, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:09:29.543869 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:39935
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:39935
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:29.627862 24151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:29.628085 24151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:29.628116 24151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:29.629336 24151 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:29.629381 24151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:29.629398 24151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:29.629415 24151 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:29.629429 24151 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:29.630986 24151 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:39935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:39935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:29.631249 24151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:29.631484 24151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:29.636319 24156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:29.636464 24151 server_base.cc:1034] running on GCE node
W20260808 07:09:29.636319 24159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:29.636376 24157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:29.636826 24151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:29.637126 24151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:29.638304 24151 hybrid_clock.cc:648] HybridClock initialized: now 1786172969638285 us; error 37 us; skew 500 ppm
Aug 08 07:09:29 dist-test-slave-rmhg krb5kdc[24135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172969, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:29.640829 24151 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:09:29.641436 24151 webserver.cc:460] Webserver started at http://127.29.82.126:43875/ using document root <none> and password file <none>
I20260808 07:09:29.641739 24151 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:29.641795 24151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:29.641932 24151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:29.642983 24151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "365980479ef64461960bacb49a38d40e"
format_stamp: "Formatted at 2026-08-08 07:09:29 on dist-test-slave-rmhg"
server_key: "b99e81963ce0f1e191551a5883fbb93a"
server_key_iv: "455eb937988d10df4baa7b779d8689a7"
server_key_version: "encryptionkey@0"
I20260808 07:09:29.643318 24151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "365980479ef64461960bacb49a38d40e"
format_stamp: "Formatted at 2026-08-08 07:09:29 on dist-test-slave-rmhg"
server_key: "b99e81963ce0f1e191551a5883fbb93a"
server_key_iv: "455eb937988d10df4baa7b779d8689a7"
server_key_version: "encryptionkey@0"
I20260808 07:09:29.644677 24151 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:29.645458 24175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:29.645658 24151 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:29.645758 24151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "365980479ef64461960bacb49a38d40e"
format_stamp: "Formatted at 2026-08-08 07:09:29 on dist-test-slave-rmhg"
server_key: "b99e81963ce0f1e191551a5883fbb93a"
server_key_iv: "455eb937988d10df4baa7b779d8689a7"
server_key_version: "encryptionkey@0"
I20260808 07:09:29.645825 24151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:29.675747 24151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:29.677968 24151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:29.678114 24151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:29.682019 24151 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:39935
I20260808 07:09:29.682068 24252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:39935 every 8 connection(s)
I20260808 07:09:29.682400 24151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:29.683283 24253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:29.685647 24253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e: Bootstrap starting.
I20260808 07:09:29.686218 24253 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:29.686478 24253 log.cc:824] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:29.687150 24253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e: No bootstrap required, opened a new log
I20260808 07:09:29.688690 24253 raft_consensus.cc:348] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365980479ef64461960bacb49a38d40e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 39935 } }
I20260808 07:09:29.688828 24253 raft_consensus.cc:374] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:29.688850 24253 raft_consensus.cc:729] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 365980479ef64461960bacb49a38d40e, State: Initialized, Role: FOLLOWER
I20260808 07:09:29.689003 24253 consensus_queue.cc:260] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365980479ef64461960bacb49a38d40e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 39935 } }
I20260808 07:09:29.689090 24253 raft_consensus.cc:388] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:29.689126 24253 raft_consensus.cc:482] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:29.689200 24253 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:29.689736 24253 raft_consensus.cc:504] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365980479ef64461960bacb49a38d40e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 39935 } }
I20260808 07:09:29.689826 24253 leader_election.cc:302] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 365980479ef64461960bacb49a38d40e; no voters:
I20260808 07:09:29.689888 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 24151
I20260808 07:09:29.689999 24253 leader_election.cc:288] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:29.689999 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:29.690043 24256 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:29.690207 30025 external_mini_cluster.cc:1428] Setting key 93b4abbc16cadbcbbb7f3072a9d19310
I20260808 07:09:29.690205 24256 raft_consensus.cc:686] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [term 1 LEADER]: Becoming Leader. State: Replica: 365980479ef64461960bacb49a38d40e, State: Running, Role: LEADER
I20260808 07:09:29.690258 24253 sys_catalog.cc:564] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:29.690297 24256 consensus_queue.cc:237] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365980479ef64461960bacb49a38d40e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 39935 } }
I20260808 07:09:29.691032 24258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 365980479ef64461960bacb49a38d40e. Latest consensus state: current_term: 1 leader_uuid: "365980479ef64461960bacb49a38d40e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365980479ef64461960bacb49a38d40e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 39935 } } }
I20260808 07:09:29.691114 24258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:29.691500 24274 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:29.691534 24257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "365980479ef64461960bacb49a38d40e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365980479ef64461960bacb49a38d40e" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 39935 } } }
I20260808 07:09:29.691819 24257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:29.692024 24274 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:29.693641 24274 catalog_manager.cc:1347] Generated new cluster ID: cb1b612709534e668741b08094787b3a
I20260808 07:09:29.693696 24274 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:09:29 dist-test-slave-rmhg krb5kdc[24135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172969, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:09:29.701831 24267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:29.690701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46920 (local address 127.29.82.126:39935)
0808 07:09:29.691018 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:29.691028 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:29.691058 (+ 30us) server_negotiation.cc:407] Connection header received
0808 07:09:29.691179 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:29.691186 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:29.691266 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:29.692195 (+ 929us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:29.692288 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:29.693667 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:29.694790 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:29.695409 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:29.695518 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:29.698294 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:29.698300 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:29.698300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:29.698315 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:29.700191 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:29.700562 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:29.700565 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:29.700565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:29.700697 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:29.700867 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:29.700868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:29.700868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:29.701232 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:29.701384 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:29.701453 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 07:09:29.701596 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":64,"threads_started":1}
I20260808 07:09:29.704120 24274 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:29.704882 24274 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:29.710786 24274 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e: Generated new TSK 0
I20260808 07:09:29.710973 24274 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:09:29.740413 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:39935
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:29.824045 24299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:29.824267 24299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:29.824290 24299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:29.825554 24299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:29.825598 24299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:29.825628 24299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:09:29.827126 24299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:39935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:29.827359 24299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:29.827584 24299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:29.832525 24308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:29.832499 24309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:29.832557 24299 server_base.cc:1034] running on GCE node
W20260808 07:09:29.832470 24311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:29.832995 24299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:29.833256 24299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:29.834406 24299 hybrid_clock.cc:648] HybridClock initialized: now 1786172969834394 us; error 29 us; skew 500 ppm
Aug 08 07:09:29 dist-test-slave-rmhg krb5kdc[24135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172969, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:29.836932 24299 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:09:29.837432 24299 webserver.cc:460] Webserver started at http://127.29.82.65:44081/ using document root <none> and password file <none>
I20260808 07:09:29.837641 24299 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:29.837682 24299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:29.837777 24299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:29.838816 24299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "0f2cf7268e574fb18323ab1d96b6aecd"
format_stamp: "Formatted at 2026-08-08 07:09:29 on dist-test-slave-rmhg"
server_key: "827dcf65607e942474f4bed6c08fdc7e"
server_key_iv: "0b85dd0343267bb9f24fb1254060eee9"
server_key_version: "encryptionkey@0"
I20260808 07:09:29.839125 24299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "0f2cf7268e574fb18323ab1d96b6aecd"
format_stamp: "Formatted at 2026-08-08 07:09:29 on dist-test-slave-rmhg"
server_key: "827dcf65607e942474f4bed6c08fdc7e"
server_key_iv: "0b85dd0343267bb9f24fb1254060eee9"
server_key_version: "encryptionkey@0"
I20260808 07:09:29.840330 24299 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:29.841012 24319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:29.841223 24299 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:29.841325 24299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "0f2cf7268e574fb18323ab1d96b6aecd"
format_stamp: "Formatted at 2026-08-08 07:09:29 on dist-test-slave-rmhg"
server_key: "827dcf65607e942474f4bed6c08fdc7e"
server_key_iv: "0b85dd0343267bb9f24fb1254060eee9"
server_key_version: "encryptionkey@0"
I20260808 07:09:29.841398 24299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:29.851632 24299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:29.853816 24299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:29.853935 24299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:29.854137 24299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:29.854449 24299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:29.854483 24299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:29.854513 24299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:29.854529 24299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:29.860162 24299 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:33055
I20260808 07:09:29.860208 24488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:33055 every 8 connection(s)
I20260808 07:09:29.860544 24299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:09:29.866148 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 24299
I20260808 07:09:29.866261 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:09:29.866456 30025 external_mini_cluster.cc:1428] Setting key a857e54f4a54be0e5ede94fceaa5f654
Aug 08 07:09:29 dist-test-slave-rmhg krb5kdc[24135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172969, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:09:29.870447 24267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:29.861341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:39337 (local address 127.29.82.126:39935)
0808 07:09:29.861407 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:29.861409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:29.861631 (+ 222us) server_negotiation.cc:407] Connection header received
0808 07:09:29.862153 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:29.862154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:29.862172 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:29.862229 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:29.863301 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:29.863818 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:29.864869 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:29.865090 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:29.865170 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:29.867558 (+ 2388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:29.867560 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:29.867561 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:29.867569 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:29.868896 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:29.869422 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:29.869424 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:29.869425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:29.869511 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:29.869809 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:29.869810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:29.869810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:29.869955 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:29.870030 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:29.870296 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 07:09:29.870379 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:09:29.870625 24492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:29.861332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:39935 (local address 127.29.82.65:39337)
0808 07:09:29.861500 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:29.861540 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:29.862049 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:29.862314 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:29.862317 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:29.862965 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:29.863181 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:29.863187 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:29.863912 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:29.863914 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:29.864779 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:29.864782 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:29.865192 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:29.865193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:29.865324 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:29.865865 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:29.865876 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:29.867462 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:29.868992 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:29.869003 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:29.869006 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:29.869342 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:29.869613 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:29.869614 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:29.869614 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:29.869744 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:29.870027 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:29.870033 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:29.870168 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 07:09:29.870266 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 07:09:29.870405 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":73,"threads_started":1}
I20260808 07:09:29.871351 24489 heartbeater.cc:347] Connected to a master server at 127.29.82.126:39935
I20260808 07:09:29.871467 24489 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:29.871676 24489 heartbeater.cc:511] Master 127.29.82.126:39935 requested a full tablet report, sending...
I20260808 07:09:29.872285 24196 ts_manager.cc:194] Registered new tserver with Master: 0f2cf7268e574fb18323ab1d96b6aecd (127.29.82.65:33055)
I20260808 07:09:29.873255 24196 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:39337
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:09:29.895771 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:39935
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:29.980331 24497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:29.980545 24497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:29.980568 24497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:29.981712 24497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:29.981750 24497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:29.981774 24497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:09:29.983184 24497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:39935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:29.983371 24497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:29.983560 24497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:29.988567 24508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:29.988616 24511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:29.988580 24503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:29.988770 24497 server_base.cc:1034] running on GCE node
I20260808 07:09:29.988953 24497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:29.989203 24497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:29.990360 24497 hybrid_clock.cc:648] HybridClock initialized: now 1786172969990345 us; error 25 us; skew 500 ppm
Aug 08 07:09:29 dist-test-slave-rmhg krb5kdc[24135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172969, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:29.992902 24497 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:09:29.993353 24497 webserver.cc:460] Webserver started at http://127.29.82.66:41389/ using document root <none> and password file <none>
I20260808 07:09:29.993541 24497 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:29.993580 24497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:29.993669 24497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:29.994653 24497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "6227acf6c04241b787c8b0f547eb0666"
format_stamp: "Formatted at 2026-08-08 07:09:29 on dist-test-slave-rmhg"
server_key: "f338ca5bc1f4cc7bf3c413b318d34a24"
server_key_iv: "a019d97b88a723aa87a724c15d386265"
server_key_version: "encryptionkey@0"
I20260808 07:09:29.994966 24497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "6227acf6c04241b787c8b0f547eb0666"
format_stamp: "Formatted at 2026-08-08 07:09:29 on dist-test-slave-rmhg"
server_key: "f338ca5bc1f4cc7bf3c413b318d34a24"
server_key_iv: "a019d97b88a723aa87a724c15d386265"
server_key_version: "encryptionkey@0"
I20260808 07:09:29.996173 24497 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:09:29.996868 24523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:29.997030 24497 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:29.997114 24497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "6227acf6c04241b787c8b0f547eb0666"
format_stamp: "Formatted at 2026-08-08 07:09:29 on dist-test-slave-rmhg"
server_key: "f338ca5bc1f4cc7bf3c413b318d34a24"
server_key_iv: "a019d97b88a723aa87a724c15d386265"
server_key_version: "encryptionkey@0"
I20260808 07:09:29.997205 24497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:30.004251 24497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:30.006258 24497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:30.006371 24497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:30.006561 24497 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:30.006866 24497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:30.006899 24497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.006922 24497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:30.006949 24497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.012477 24497 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:45925
I20260808 07:09:30.012548 24680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:45925 every 8 connection(s)
I20260808 07:09:30.012825 24497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:09:30 dist-test-slave-rmhg krb5kdc[24135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172969, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:09:30.021621 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 24497
I20260808 07:09:30.021749 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:09:30.021967 30025 external_mini_cluster.cc:1428] Setting key d912e071ebdee651d9ee399932f9600e
I20260808 07:09:30.022142 24267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.013574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:46123 (local address 127.29.82.126:39935)
0808 07:09:30.013658 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.013660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.013760 (+ 100us) server_negotiation.cc:407] Connection header received
0808 07:09:30.014239 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.014240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.014249 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.014295 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:30.015258 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.015794 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.016838 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.017048 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.017104 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.019253 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:30.019254 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:30.019255 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:30.019262 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:30.020560 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:30.021030 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:30.021031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:30.021031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:30.021104 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:30.021386 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:30.021387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:30.021387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:30.021523 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:30.021594 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.021949 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.022040 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 07:09:30.022405 24683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.013506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:39935 (local address 127.29.82.66:46123)
0808 07:09:30.013659 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:30.013696 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:30.014159 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:30.014358 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:30.014362 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:30.014941 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:30.015145 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.015151 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.015886 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.015887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.016751 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.016754 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.017143 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.017144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.017313 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.017821 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:30.017831 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:30.019148 (+ 1317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:30.020653 (+ 1505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:30.020676 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:30.020679 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:30.020951 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:30.021193 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:30.021194 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:30.021194 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:30.021301 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:30.021604 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:30.021613 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:30.021791 (+ 178us) client_negotiation.cc:769] Sending connection context
0808 07:09:30.021915 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 07:09:30.022091 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":65,"threads_started":1}
I20260808 07:09:30.022874 24681 heartbeater.cc:347] Connected to a master server at 127.29.82.126:39935
I20260808 07:09:30.022979 24681 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:30.023160 24681 heartbeater.cc:511] Master 127.29.82.126:39935 requested a full tablet report, sending...
I20260808 07:09:30.023595 24196 ts_manager.cc:194] Registered new tserver with Master: 6227acf6c04241b787c8b0f547eb0666 (127.29.82.66:45925)
I20260808 07:09:30.023972 24196 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:46123
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:09:30.047984 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:39935
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:46289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:30.130173 24687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:30.130380 24687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:30.130409 24687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:30.131526 24687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:30.131572 24687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:30.131614 24687 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:09:30.133023 24687 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:46289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:39935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:30.133289 24687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:30.133500 24687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:30.138417 24695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:30.138417 24697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:30.138432 24694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:30.138680 24687 server_base.cc:1034] running on GCE node
I20260808 07:09:30.138870 24687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:30.139106 24687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:30.140251 24687 hybrid_clock.cc:648] HybridClock initialized: now 1786172970140235 us; error 30 us; skew 500 ppm
Aug 08 07:09:30 dist-test-slave-rmhg krb5kdc[24135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172970, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:30.142838 24687 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:09:30.143308 24687 webserver.cc:460] Webserver started at http://127.29.82.67:41289/ using document root <none> and password file <none>
I20260808 07:09:30.143556 24687 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:30.143610 24687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:30.143734 24687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:30.144863 24687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "bbcf009f431243f79aa77aa006e32043"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "57413d8c918949ea91472191d99855ac"
server_key_iv: "e30aebbce9aaf5f726456383d8d2e36b"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.145257 24687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "bbcf009f431243f79aa77aa006e32043"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "57413d8c918949ea91472191d99855ac"
server_key_iv: "e30aebbce9aaf5f726456383d8d2e36b"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.146611 24687 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:30.147373 24708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.147578 24687 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:30.147671 24687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "bbcf009f431243f79aa77aa006e32043"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "57413d8c918949ea91472191d99855ac"
server_key_iv: "e30aebbce9aaf5f726456383d8d2e36b"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.147737 24687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:30.159883 24687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:30.161935 24687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:30.162074 24687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:30.162297 24687 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:30.162608 24687 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:30.162643 24687 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.162672 24687 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:30.162698 24687 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.168190 24687 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:32983
I20260808 07:09:30.168233 24875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:32983 every 8 connection(s)
I20260808 07:09:30.168548 24687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:09:30.173804 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 24687
I20260808 07:09:30.173909 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:09:30.174083 30025 external_mini_cluster.cc:1428] Setting key 7d6b17a6bba363c0bb6d0bbbf3b27f86
Aug 08 07:09:30 dist-test-slave-rmhg krb5kdc[24135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172970, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:09:30.177094 24267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.169271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:49255 (local address 127.29.82.126:39935)
0808 07:09:30.169330 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.169333 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.169511 (+ 178us) server_negotiation.cc:407] Connection header received
0808 07:09:30.169993 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.169994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.170004 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.170069 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:30.170969 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.171460 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.172386 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.172564 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.172605 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.174795 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:30.174797 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:30.174797 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:30.174804 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:30.176009 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:30.176382 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:30.176383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:30.176383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:30.176430 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:30.176604 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:30.176605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:30.176605 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:30.176703 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:30.176747 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.176960 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.177020 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:09:30.177309 24880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.169235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:39935 (local address 127.29.82.67:49255)
0808 07:09:30.169393 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:30.169435 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:30.169913 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:30.170133 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:30.170137 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:30.170697 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:30.170895 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.170899 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.171522 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.171522 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.172328 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.172330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.172617 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.172618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.172719 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.173205 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:30.173214 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:30.174704 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:30.176091 (+ 1387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:30.176097 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:30.176099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:30.176320 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:30.176474 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:30.176474 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:30.176474 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:30.176563 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:30.176745 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:30.176748 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:30.176859 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 07:09:30.176941 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 07:09:30.177072 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":70,"threads_started":1}
I20260808 07:09:30.177735 24876 heartbeater.cc:347] Connected to a master server at 127.29.82.126:39935
I20260808 07:09:30.177819 24876 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:30.178000 24876 heartbeater.cc:511] Master 127.29.82.126:39935 requested a full tablet report, sending...
I20260808 07:09:30.178345 24196 ts_manager.cc:194] Registered new tserver with Master: bbcf009f431243f79aa77aa006e32043 (127.29.82.67:32983)
I20260808 07:09:30.178691 24196 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:49255
I20260808 07:09:30.185848 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:09:30.193480 24267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.187221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46930 (local address 127.29.82.126:39935)
0808 07:09:30.187281 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.187283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.187385 (+ 102us) server_negotiation.cc:407] Connection header received
0808 07:09:30.187451 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.187452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.187462 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.187507 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:30.188077 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.188568 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.189326 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.189525 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.189580 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.190941 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:30.190943 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:30.190943 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:30.190951 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:30.192301 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:30.192673 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:30.192674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:30.192675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:30.192733 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:30.192925 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:30.192926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:30.192926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:30.193074 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:30.193189 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.193326 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.193386 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:09:30.194908 24196 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:09:30.196419 24196 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:09:30.202502 24891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.198417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:32983 (local address 127.0.0.1:49026)
0808 07:09:30.198799 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:30.198807 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:30.198841 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:30.199058 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:30.199061 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:30.199063 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:30.199133 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.199135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.200512 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.200513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.201386 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.201389 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.202230 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.202232 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.202313 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.202327 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 07:09:30.202374 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:09:30.202426 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":64,"threads_started":1}
I20260808 07:09:30.202812 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.198414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:33055 (local address 127.0.0.1:53614)
0808 07:09:30.198592 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:30.198632 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:30.198704 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:30.199164 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:30.199165 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:30.199167 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:30.199209 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.199211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.200484 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.200485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.201613 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.201616 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.202463 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.202464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.202531 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.202536 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:09:30.202700 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 07:09:30.202740 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":34,"thread_start_us":62,"threads_started":1}
I20260808 07:09:30.202838 24893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.198541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53614 (local address 127.29.82.65:33055)
0808 07:09:30.198939 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.198943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.198953 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:09:30.198992 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.198994 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.199009 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.199090 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:30.199279 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.200395 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.201690 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.202385 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.202446 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.202504 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.202728 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.202768 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":80,"threads_started":1}
I20260808 07:09:30.202831 24896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.198726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49026 (local address 127.29.82.67:32983)
0808 07:09:30.198888 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.198892 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.198901 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:09:30.198939 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.198940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.198956 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.199053 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:30.199235 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.200392 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.201468 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.202129 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.202635 (+ 506us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.202688 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.202713 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.202753 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":81,"threads_started":1}
I20260808 07:09:30.203177 24889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.198417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:45925 (local address 127.0.0.1:51048)
0808 07:09:30.198904 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:30.198913 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:30.198958 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:30.199175 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:30.199176 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:30.199179 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:30.199224 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.199226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.200236 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.200237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.201825 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.201828 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.202956 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.202957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.203022 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.203026 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:30.203064 (+ 38us) client_negotiation.cc:240] Negotiation successful
0808 07:09:30.203103 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":34,"thread_start_us":60,"threads_started":1}
I20260808 07:09:30.203401 24894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.198684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51048 (local address 127.29.82.66:45925)
0808 07:09:30.198858 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.198863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.198963 (+ 100us) server_negotiation.cc:407] Connection header received
0808 07:09:30.199009 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.199011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.199025 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.199091 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:30.199302 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.200151 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.201904 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.202382 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.202445 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.202504 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.203275 (+ 771us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.203326 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":84,"threads_started":1}
I20260808 07:09:30.203547 24779 tablet_service.cc:1467] Processing CreateTablet for tablet a73bb3a1e711401a91c1eb7d7d984329 (DEFAULT_TABLE table=test-table [id=b68014fca4544e279db3d3b553764316]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:30.203522 24396 tablet_service.cc:1467] Processing CreateTablet for tablet a73bb3a1e711401a91c1eb7d7d984329 (DEFAULT_TABLE table=test-table [id=b68014fca4544e279db3d3b553764316]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:30.203905 24779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a73bb3a1e711401a91c1eb7d7d984329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:30.203907 24396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a73bb3a1e711401a91c1eb7d7d984329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:30.207366 24898 tablet_bootstrap.cc:492] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043: Bootstrap starting.
I20260808 07:09:30.208108 24898 tablet_bootstrap.cc:654] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:30.208110 24587 tablet_service.cc:1467] Processing CreateTablet for tablet a73bb3a1e711401a91c1eb7d7d984329 (DEFAULT_TABLE table=test-table [id=b68014fca4544e279db3d3b553764316]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:30.208506 24587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a73bb3a1e711401a91c1eb7d7d984329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:30.208671 24898 log.cc:824] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:30.209059 24899 tablet_bootstrap.cc:492] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd: Bootstrap starting.
I20260808 07:09:30.209483 24898 tablet_bootstrap.cc:492] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043: No bootstrap required, opened a new log
I20260808 07:09:30.209549 24898 ts_tablet_manager.cc:1397] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:09:30.209853 24899 tablet_bootstrap.cc:654] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:30.210402 24899 log.cc:824] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:30.211261 24899 tablet_bootstrap.cc:492] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd: No bootstrap required, opened a new log
I20260808 07:09:30.211340 24899 ts_tablet_manager.cc:1397] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:09:30.211262 24898 raft_consensus.cc:348] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2cf7268e574fb18323ab1d96b6aecd" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33055 } } peers { permanent_uuid: "6227acf6c04241b787c8b0f547eb0666" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45925 } } peers { permanent_uuid: "bbcf009f431243f79aa77aa006e32043" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 32983 } }
I20260808 07:09:30.211447 24898 raft_consensus.cc:374] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:30.211490 24898 raft_consensus.cc:729] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbcf009f431243f79aa77aa006e32043, State: Initialized, Role: FOLLOWER
I20260808 07:09:30.211613 24898 consensus_queue.cc:260] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2cf7268e574fb18323ab1d96b6aecd" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33055 } } peers { permanent_uuid: "6227acf6c04241b787c8b0f547eb0666" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45925 } } peers { permanent_uuid: "bbcf009f431243f79aa77aa006e32043" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 32983 } }
I20260808 07:09:30.211935 24905 tablet_bootstrap.cc:492] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666: Bootstrap starting.
I20260808 07:09:30.211891 24898 ts_tablet_manager.cc:1428] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:09:30.212179 24876 heartbeater.cc:503] Master 127.29.82.126:39935 was elected leader, sending a full tablet report...
I20260808 07:09:30.212612 24905 tablet_bootstrap.cc:654] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:30.213195 24905 log.cc:824] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:30.213093 24899 raft_consensus.cc:348] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2cf7268e574fb18323ab1d96b6aecd" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33055 } } peers { permanent_uuid: "6227acf6c04241b787c8b0f547eb0666" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45925 } } peers { permanent_uuid: "bbcf009f431243f79aa77aa006e32043" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 32983 } }
I20260808 07:09:30.213316 24899 raft_consensus.cc:374] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:30.213366 24899 raft_consensus.cc:729] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f2cf7268e574fb18323ab1d96b6aecd, State: Initialized, Role: FOLLOWER
I20260808 07:09:30.213485 24899 consensus_queue.cc:260] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2cf7268e574fb18323ab1d96b6aecd" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33055 } } peers { permanent_uuid: "6227acf6c04241b787c8b0f547eb0666" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45925 } } peers { permanent_uuid: "bbcf009f431243f79aa77aa006e32043" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 32983 } }
I20260808 07:09:30.213761 24899 ts_tablet_manager.cc:1428] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 07:09:30.213783 24489 heartbeater.cc:503] Master 127.29.82.126:39935 was elected leader, sending a full tablet report...
I20260808 07:09:30.214397 24905 tablet_bootstrap.cc:492] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666: No bootstrap required, opened a new log
I20260808 07:09:30.214469 24905 ts_tablet_manager.cc:1397] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260808 07:09:30.215864 24905 raft_consensus.cc:348] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2cf7268e574fb18323ab1d96b6aecd" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33055 } } peers { permanent_uuid: "6227acf6c04241b787c8b0f547eb0666" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45925 } } peers { permanent_uuid: "bbcf009f431243f79aa77aa006e32043" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 32983 } }
I20260808 07:09:30.216001 24905 raft_consensus.cc:374] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:30.216022 24905 raft_consensus.cc:729] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6227acf6c04241b787c8b0f547eb0666, State: Initialized, Role: FOLLOWER
I20260808 07:09:30.216120 24905 consensus_queue.cc:260] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2cf7268e574fb18323ab1d96b6aecd" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33055 } } peers { permanent_uuid: "6227acf6c04241b787c8b0f547eb0666" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45925 } } peers { permanent_uuid: "bbcf009f431243f79aa77aa006e32043" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 32983 } }
I20260808 07:09:30.216351 24905 ts_tablet_manager.cc:1428] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:09:30.216401 24681 heartbeater.cc:503] Master 127.29.82.126:39935 was elected leader, sending a full tablet report...
W20260808 07:09:30.263441 24682 tablet.cc:2369] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:09:30.319268 24902 raft_consensus.cc:482] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:30.319419 24902 raft_consensus.cc:504] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2cf7268e574fb18323ab1d96b6aecd" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33055 } } peers { permanent_uuid: "6227acf6c04241b787c8b0f547eb0666" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45925 } } peers { permanent_uuid: "bbcf009f431243f79aa77aa006e32043" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 32983 } }
I20260808 07:09:30.319792 24902 leader_election.cc:288] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f2cf7268e574fb18323ab1d96b6aecd (127.29.82.65:33055), 6227acf6c04241b787c8b0f547eb0666 (127.29.82.66:45925)
I20260808 07:09:30.322536 24893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.320033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:45597 (local address 127.29.82.65:33055)
0808 07:09:30.320074 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.320076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.320086 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:09:30.320163 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.320164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.320174 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.320222 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:30.320369 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.320844 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.321821 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.322208 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.322288 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.322298 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.322424 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.322462 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:09:30.322536 24880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.319963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:33055 (local address 127.29.82.67:45597)
0808 07:09:30.320027 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:30.320040 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:30.320084 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:30.320231 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:30.320232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:30.320233 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:30.320307 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.320308 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.320917 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.320918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.321734 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.321736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.322296 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.322297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.322367 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.322370 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:09:30.322412 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 07:09:30.322462 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 07:09:30.322659 24909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.320013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:45925 (local address 127.29.82.67:42811)
0808 07:09:30.320230 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:30.320238 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:30.320310 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:30.320437 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:30.320438 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:30.320440 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:30.320512 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.320514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.321118 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.321119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.321856 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.321858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.322418 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.322419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.322485 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.322488 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:09:30.322541 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 07:09:30.322579 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":150,"threads_started":1}
I20260808 07:09:30.322651 24894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.320069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:42811 (local address 127.29.82.66:45925)
0808 07:09:30.320119 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.320121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.320307 (+ 186us) server_negotiation.cc:407] Connection header received
0808 07:09:30.320365 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.320366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.320376 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.320423 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:30.320574 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.321043 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.321945 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.322347 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.322409 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.322417 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.322554 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.322589 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:09:30.322907 24423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a73bb3a1e711401a91c1eb7d7d984329" candidate_uuid: "bbcf009f431243f79aa77aa006e32043" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f2cf7268e574fb18323ab1d96b6aecd" is_pre_election: true
I20260808 07:09:30.322988 24615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a73bb3a1e711401a91c1eb7d7d984329" candidate_uuid: "bbcf009f431243f79aa77aa006e32043" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6227acf6c04241b787c8b0f547eb0666" is_pre_election: true
I20260808 07:09:30.323056 24423 raft_consensus.cc:2454] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbcf009f431243f79aa77aa006e32043 in term 0.
I20260808 07:09:30.323145 24615 raft_consensus.cc:2454] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbcf009f431243f79aa77aa006e32043 in term 0.
I20260808 07:09:30.323275 24713 leader_election.cc:302] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f2cf7268e574fb18323ab1d96b6aecd, bbcf009f431243f79aa77aa006e32043; no voters:
I20260808 07:09:30.323457 24902 raft_consensus.cc:2781] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:09:30.323549 24902 raft_consensus.cc:482] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:09:30.323577 24902 raft_consensus.cc:3037] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:30.324247 24902 raft_consensus.cc:504] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2cf7268e574fb18323ab1d96b6aecd" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33055 } } peers { permanent_uuid: "6227acf6c04241b787c8b0f547eb0666" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45925 } } peers { permanent_uuid: "bbcf009f431243f79aa77aa006e32043" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 32983 } }
I20260808 07:09:30.324371 24902 leader_election.cc:288] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [CANDIDATE]: Term 1 election: Requested vote from peers 0f2cf7268e574fb18323ab1d96b6aecd (127.29.82.65:33055), 6227acf6c04241b787c8b0f547eb0666 (127.29.82.66:45925)
I20260808 07:09:30.324565 24423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a73bb3a1e711401a91c1eb7d7d984329" candidate_uuid: "bbcf009f431243f79aa77aa006e32043" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f2cf7268e574fb18323ab1d96b6aecd"
I20260808 07:09:30.324565 24615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a73bb3a1e711401a91c1eb7d7d984329" candidate_uuid: "bbcf009f431243f79aa77aa006e32043" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6227acf6c04241b787c8b0f547eb0666"
I20260808 07:09:30.324654 24423 raft_consensus.cc:3037] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:30.324654 24615 raft_consensus.cc:3037] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:30.325598 24615 raft_consensus.cc:2454] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbcf009f431243f79aa77aa006e32043 in term 1.
I20260808 07:09:30.325598 24423 raft_consensus.cc:2454] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbcf009f431243f79aa77aa006e32043 in term 1.
I20260808 07:09:30.325783 24710 leader_election.cc:302] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6227acf6c04241b787c8b0f547eb0666, bbcf009f431243f79aa77aa006e32043; no voters:
I20260808 07:09:30.325886 24902 raft_consensus.cc:2781] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:30.326048 24902 raft_consensus.cc:686] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [term 1 LEADER]: Becoming Leader. State: Replica: bbcf009f431243f79aa77aa006e32043, State: Running, Role: LEADER
I20260808 07:09:30.326159 24902 consensus_queue.cc:237] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2cf7268e574fb18323ab1d96b6aecd" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33055 } } peers { permanent_uuid: "6227acf6c04241b787c8b0f547eb0666" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45925 } } peers { permanent_uuid: "bbcf009f431243f79aa77aa006e32043" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 32983 } }
I20260808 07:09:30.327037 24196 catalog_manager.cc:5495] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 reported cstate change: term changed from 0 to 1, leader changed from <none> to bbcf009f431243f79aa77aa006e32043 (127.29.82.67). New cstate: current_term: 1 leader_uuid: "bbcf009f431243f79aa77aa006e32043" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f2cf7268e574fb18323ab1d96b6aecd" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6227acf6c04241b787c8b0f547eb0666" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbcf009f431243f79aa77aa006e32043" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 32983 } health_report { overall_health: HEALTHY } } }
I20260808 07:09:30.348222 24896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.345828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49030 (local address 127.29.82.67:32983)
0808 07:09:30.345890 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.345892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.345901 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:09:30.345979 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.345980 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.346002 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.346068 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:09:30.346198 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.346693 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.347434 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.347640 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.347694 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.347864 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:09:30.347963 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:09:30.348051 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.348102 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.348113 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:09:30.350212 24423 raft_consensus.cc:1261] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd [term 1 FOLLOWER]: Refusing update from remote peer bbcf009f431243f79aa77aa006e32043: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:30.350212 24615 raft_consensus.cc:1261] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666 [term 1 FOLLOWER]: Refusing update from remote peer bbcf009f431243f79aa77aa006e32043: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:30.350567 24902 consensus_queue.cc:1035] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f2cf7268e574fb18323ab1d96b6aecd" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 33055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:30.350714 24910 consensus_queue.cc:1035] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6227acf6c04241b787c8b0f547eb0666" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:30.353647 24914 mvcc.cc:205] Tried to move back new op lower bound from 7316164486551834624 to 7316164486456651776. Current Snapshot: MvccSnapshot[applied={T|T < 7316164486551834624}]
I20260808 07:09:30.354027 24915 mvcc.cc:205] Tried to move back new op lower bound from 7316164486551834624 to 7316164486456651776. Current Snapshot: MvccSnapshot[applied={T|T < 7316164486551834624}]
I20260808 07:09:30.355482 24195 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:30.355573 24195 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:30.356295 24195 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 365980479ef64461960bacb49a38d40e: Sending DeleteTablet for 3 replicas of tablet a73bb3a1e711401a91c1eb7d7d984329
I20260808 07:09:30.356669 24779 tablet_service.cc:1514] Processing DeleteTablet for tablet a73bb3a1e711401a91c1eb7d7d984329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:30 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:49026
I20260808 07:09:30.356701 24396 tablet_service.cc:1514] Processing DeleteTablet for tablet a73bb3a1e711401a91c1eb7d7d984329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:30 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:53614
I20260808 07:09:30.356912 24587 tablet_service.cc:1514] Processing DeleteTablet for tablet a73bb3a1e711401a91c1eb7d7d984329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:30 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:51048
I20260808 07:09:30.356927 24927 tablet_replica.cc:330] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd: stopping tablet replica
I20260808 07:09:30.357033 24927 raft_consensus.cc:2229] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:30.357110 24929 tablet_replica.cc:330] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666: stopping tablet replica
I20260808 07:09:30.357133 24927 raft_consensus.cc:2258] T a73bb3a1e711401a91c1eb7d7d984329 P 0f2cf7268e574fb18323ab1d96b6aecd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:30.357237 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 24299
I20260808 07:09:30.357311 24926 tablet_replica.cc:330] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043: stopping tablet replica
I20260808 07:09:30.357390 24926 raft_consensus.cc:2229] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:09:30.357511 24926 raft_consensus.cc:2258] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:30.358093 24929 raft_consensus.cc:2229] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:30.358107 24926 ts_tablet_manager.cc:1905] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:30.358242 24929 raft_consensus.cc:2258] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:30.359759 24926 ts_tablet_manager.cc:1918] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:30.359823 24926 log.cc:1196] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/a73bb3a1e711401a91c1eb7d7d984329
I20260808 07:09:30.360088 24926 ts_tablet_manager.cc:1939] T a73bb3a1e711401a91c1eb7d7d984329 P bbcf009f431243f79aa77aa006e32043: Deleting consensus metadata
I20260808 07:09:30.361585 24929 ts_tablet_manager.cc:1905] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:30.362411 24178 catalog_manager.cc:4841] TS bbcf009f431243f79aa77aa006e32043 (127.29.82.67:32983): tablet a73bb3a1e711401a91c1eb7d7d984329 (table test-table [id=b68014fca4544e279db3d3b553764316]) successfully deleted
I20260808 07:09:30.363176 24929 ts_tablet_manager.cc:1918] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:30.363245 24929 log.cc:1196] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/a73bb3a1e711401a91c1eb7d7d984329
I20260808 07:09:30.363531 24929 ts_tablet_manager.cc:1939] T a73bb3a1e711401a91c1eb7d7d984329 P 6227acf6c04241b787c8b0f547eb0666: Deleting consensus metadata
I20260808 07:09:30.364019 24176 catalog_manager.cc:4841] TS 6227acf6c04241b787c8b0f547eb0666 (127.29.82.66:45925): tablet a73bb3a1e711401a91c1eb7d7d984329 (table test-table [id=b68014fca4544e279db3d3b553764316]) successfully deleted
W20260808 07:09:30.372586 24181 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:33055 (error 108)
I20260808 07:09:30.372841 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 24497
I20260808 07:09:30.373116 24889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.372996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:33055 (local address 127.0.0.1:53618)
0808 07:09:30.373053 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:30.373084 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:33055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 07:09:30.373230 24181 catalog_manager.cc:4584] TS 0f2cf7268e574fb18323ab1d96b6aecd (127.29.82.65:33055): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a73bb3a1e711401a91c1eb7d7d984329: Network error: Client connection negotiation failed: client connection to 127.29.82.65:33055: connect: Connection refused (error 111)
I20260808 07:09:30.382539 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 24687
I20260808 07:09:30.389192 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 24151
2026-08-08T07:09:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2092 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T07:09:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:30Z Disabled control of system clock
I20260808 07:09:30.422809 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:32807
--webserver_interface=127.29.82.126
--webserver_port=0
--builtin_ntp_servers=127.29.82.84:40951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:32807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:09:30.506251 24935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:30.506495 24935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:30.506518 24935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:30.507665 24935 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:30.507704 24935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:30.507715 24935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:30.507726 24935 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:30.507736 24935 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:30.509063 24935 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:32807
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:32807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:30.509313 24935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:30.509588 24935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:30.514273 24946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:30.514292 24940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:30.514346 24942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:30.514568 24935 server_base.cc:1034] running on GCE node
I20260808 07:09:30.514827 24935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:30.515100 24935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:30.516232 24935 hybrid_clock.cc:648] HybridClock initialized: now 1786172970516218 us; error 28 us; skew 500 ppm
I20260808 07:09:30.522485 24935 webserver.cc:460] Webserver started at http://127.29.82.126:45211/ using document root <none> and password file <none>
I20260808 07:09:30.522761 24935 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:30.522816 24935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:30.522954 24935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:30.524076 24935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "42595a155e7440d2bbef26e79abde37f"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "81506cab2ea15a72238a253fdf1ea59f"
server_key_iv: "fc72a64e988ecf9a8593a274bafe907e"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.524432 24935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "42595a155e7440d2bbef26e79abde37f"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "81506cab2ea15a72238a253fdf1ea59f"
server_key_iv: "fc72a64e988ecf9a8593a274bafe907e"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.525811 24935 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:30.526518 24955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.526679 24935 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:30.526772 24935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "42595a155e7440d2bbef26e79abde37f"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "81506cab2ea15a72238a253fdf1ea59f"
server_key_iv: "fc72a64e988ecf9a8593a274bafe907e"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.526834 24935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:30.534209 24935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:30.534533 24935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:30.534664 24935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:30.538460 24935 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:32807
I20260808 07:09:30.538539 25031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:32807 every 8 connection(s)
I20260808 07:09:30.538828 24935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:30.539852 25032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:30.542219 25032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f: Bootstrap starting.
I20260808 07:09:30.542831 25032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:30.543076 25032 log.cc:824] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:30.543758 25032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f: No bootstrap required, opened a new log
I20260808 07:09:30.546099 25032 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42595a155e7440d2bbef26e79abde37f" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 32807 } }
I20260808 07:09:30.546322 25032 raft_consensus.cc:374] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:30.546388 25032 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42595a155e7440d2bbef26e79abde37f, State: Initialized, Role: FOLLOWER
I20260808 07:09:30.546556 25032 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42595a155e7440d2bbef26e79abde37f" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 32807 } }
I20260808 07:09:30.546680 25032 raft_consensus.cc:388] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:30.546727 25032 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:30.546774 25032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:30.547286 25032 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42595a155e7440d2bbef26e79abde37f" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 32807 } }
I20260808 07:09:30.547374 25032 leader_election.cc:302] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42595a155e7440d2bbef26e79abde37f; no voters:
I20260808 07:09:30.547556 25032 leader_election.cc:288] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:30.547613 25035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:30.547640 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 24935
I20260808 07:09:30.547741 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:30.547781 25035 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [term 1 LEADER]: Becoming Leader. State: Replica: 42595a155e7440d2bbef26e79abde37f, State: Running, Role: LEADER
I20260808 07:09:30.547838 25032 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:30.547962 30025 external_mini_cluster.cc:1428] Setting key ab7a4681048b705809a00f15f5348fb5
I20260808 07:09:30.547919 25035 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42595a155e7440d2bbef26e79abde37f" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 32807 } }
I20260808 07:09:30.548591 25036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "42595a155e7440d2bbef26e79abde37f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42595a155e7440d2bbef26e79abde37f" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 32807 } } }
I20260808 07:09:30.548676 25036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:30.548898 25038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42595a155e7440d2bbef26e79abde37f. Latest consensus state: current_term: 1 leader_uuid: "42595a155e7440d2bbef26e79abde37f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42595a155e7440d2bbef26e79abde37f" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 32807 } } }
I20260808 07:09:30.549031 25038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:30.548906 25049 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:30.549659 25049 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:30.551765 25049 catalog_manager.cc:1347] Generated new cluster ID: d0c3e4d553c84421b1483a9d5203debb
I20260808 07:09:30.551819 25049 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:30.553823 25048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.548470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57304 (local address 127.29.82.126:32807)
0808 07:09:30.548687 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.548697 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.548731 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:09:30.548860 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.548868 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.548943 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.549115 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:30.549390 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.550388 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.551420 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.552021 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.552152 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.553026 (+ 874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:30.553030 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:30.553031 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:30.553244 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:30.553282 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:30.553297 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:30.553348 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.553530 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.553608 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":87,"threads_started":1}
I20260808 07:09:30.562721 25049 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:30.563227 25049 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:30.568388 25049 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f: Generated new TSK 0
I20260808 07:09:30.568563 25049 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:30.571273 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:32807
--builtin_ntp_servers=127.29.82.84:40951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:09:30.654247 25061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:30.654460 25061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:30.654482 25061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:30.655617 25061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:30.655658 25061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:30.655682 25061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:09:30.657053 25061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:32807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:30.657279 25061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:30.657572 25061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:30.663435 25068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:30.663486 25069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:30.663694 25061 server_base.cc:1034] running on GCE node
W20260808 07:09:30.663858 25072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:30.664084 25061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:30.664319 25061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:30.665470 25061 hybrid_clock.cc:648] HybridClock initialized: now 1786172970665459 us; error 35 us; skew 500 ppm
I20260808 07:09:30.666827 25061 webserver.cc:460] Webserver started at http://127.29.82.65:45979/ using document root <none> and password file <none>
I20260808 07:09:30.667061 25061 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:30.667117 25061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:30.667248 25061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:30.668305 25061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "1610e693c6334f25b1acfc90f63f726e"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "9a7050dc5e10ad91c2927f9506998ee1"
server_key_iv: "b044327a9a5ed7745f39548453512e5f"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.668660 25061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "1610e693c6334f25b1acfc90f63f726e"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "9a7050dc5e10ad91c2927f9506998ee1"
server_key_iv: "b044327a9a5ed7745f39548453512e5f"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.670001 25061 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:09:30.670704 25079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.670889 25061 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:09:30.671001 25061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "1610e693c6334f25b1acfc90f63f726e"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "9a7050dc5e10ad91c2927f9506998ee1"
server_key_iv: "b044327a9a5ed7745f39548453512e5f"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.671072 25061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:30.681545 25061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:30.681838 25061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:30.681946 25061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:30.682149 25061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:30.682433 25061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:30.682461 25061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.682489 25061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:30.682505 25061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.687968 25061 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:36693
I20260808 07:09:30.688041 25255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:36693 every 8 connection(s)
I20260808 07:09:30.688359 25061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:09:30.693274 25048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.689072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:39853 (local address 127.29.82.126:32807)
0808 07:09:30.689187 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.689189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.689390 (+ 201us) server_negotiation.cc:407] Connection header received
0808 07:09:30.689902 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.689904 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.689918 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.689966 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:30.690608 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.691103 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.692051 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.692234 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.692280 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.693027 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:30.693028 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:30.693028 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:30.693033 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:30.693047 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:30.693052 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:30.693094 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.693176 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.693210 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 07:09:30.693485 25259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.689053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:32807 (local address 127.29.82.65:39853)
0808 07:09:30.689267 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:30.689304 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:30.689817 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:30.690028 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:30.690031 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:30.690040 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:30.690543 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.690547 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.691176 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.691176 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.691981 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.691983 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.692298 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.692299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.692409 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.692892 (+ 483us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:09:30.692892 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:30.692920 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:09:30.692942 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:30.693101 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:30.693104 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:30.693106 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:09:30.693183 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 07:09:30.693280 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":106,"threads_started":1}
I20260808 07:09:30.693969 25256 heartbeater.cc:347] Connected to a master server at 127.29.82.126:32807
I20260808 07:09:30.694054 25256 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:30.694235 25256 heartbeater.cc:511] Master 127.29.82.126:32807 requested a full tablet report, sending...
I20260808 07:09:30.694720 24977 ts_manager.cc:194] Registered new tserver with Master: 1610e693c6334f25b1acfc90f63f726e (127.29.82.65:36693)
I20260808 07:09:30.695322 24977 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.82.65:39853
I20260808 07:09:30.697129 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 25061
I20260808 07:09:30.697271 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:09:30.697491 30025 external_mini_cluster.cc:1428] Setting key b05a7af6743a87bbe8b855bf2cb3a4cb
I20260808 07:09:30.698383 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:32807
--builtin_ntp_servers=127.29.82.84:40951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:09:30.780506 25260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:30.780715 25260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:30.780745 25260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:30.781904 25260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:30.781947 25260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:30.781980 25260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:09:30.783313 25260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:32807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:30.783571 25260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:30.783859 25260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:30.788772 25268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:30.788816 25266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:30.788774 25270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:30.788954 25260 server_base.cc:1034] running on GCE node
I20260808 07:09:30.789192 25260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:30.789494 25260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:30.790645 25260 hybrid_clock.cc:648] HybridClock initialized: now 1786172970790631 us; error 27 us; skew 500 ppm
I20260808 07:09:30.791822 25260 webserver.cc:460] Webserver started at http://127.29.82.66:41643/ using document root <none> and password file <none>
I20260808 07:09:30.792061 25260 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:30.792111 25260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:30.792243 25260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:30.793331 25260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "bc8aca07dbf34badaa34d9f828112010"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "769944d1802a732ad8064a6025a2924b"
server_key_iv: "a7e27b57f220020ccde0999d72d2649f"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.793814 25260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "bc8aca07dbf34badaa34d9f828112010"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "769944d1802a732ad8064a6025a2924b"
server_key_iv: "a7e27b57f220020ccde0999d72d2649f"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.795243 25260 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:09:30.795961 25277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.796105 25260 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:30.796188 25260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "bc8aca07dbf34badaa34d9f828112010"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "769944d1802a732ad8064a6025a2924b"
server_key_iv: "a7e27b57f220020ccde0999d72d2649f"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.796257 25260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:30.804121 25260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:30.804389 25260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:30.804531 25260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:30.804738 25260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:30.805042 25260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:30.805075 25260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.805112 25260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:30.805136 25260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.810674 25260 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:36393
I20260808 07:09:30.810731 25444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:36393 every 8 connection(s)
I20260808 07:09:30.811048 25260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:09:30.813784 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 25260
I20260808 07:09:30.813880 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:09:30.814061 30025 external_mini_cluster.cc:1428] Setting key 5cb36efbaa005900f22c604a0f88b861
I20260808 07:09:30.814950 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:32807
--builtin_ntp_servers=127.29.82.84:40951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 07:09:30.816437 25048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.811735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:47511 (local address 127.29.82.126:32807)
0808 07:09:30.811794 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.811796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.812013 (+ 217us) server_negotiation.cc:407] Connection header received
0808 07:09:30.812512 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.812514 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.812526 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.812591 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:30.813322 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.813883 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.815052 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.815296 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.815353 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.816173 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:30.816174 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:30.816175 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:30.816179 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:30.816195 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:30.816199 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:30.816245 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.816327 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.816356 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:09:30.816653 25447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.811703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:32807 (local address 127.29.82.66:47511)
0808 07:09:30.811890 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:30.811930 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:30.812389 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:30.812679 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:30.812682 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:30.812691 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:30.813236 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.813242 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.813986 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.813987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.814976 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.814979 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.815378 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.815379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.815528 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.816037 (+ 509us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:09:30.816038 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:30.816068 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:09:30.816093 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:30.816254 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:30.816259 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:30.816262 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:09:30.816320 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:09:30.816423 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260808 07:09:30.817235 25445 heartbeater.cc:347] Connected to a master server at 127.29.82.126:32807
I20260808 07:09:30.817341 25445 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:30.817555 25445 heartbeater.cc:511] Master 127.29.82.126:32807 requested a full tablet report, sending...
I20260808 07:09:30.817909 24977 ts_manager.cc:194] Registered new tserver with Master: bc8aca07dbf34badaa34d9f828112010 (127.29.82.66:36393)
I20260808 07:09:30.818248 24977 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.82.66:47511
W20260808 07:09:30.897924 25448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:30.898142 25448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:30.898170 25448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:30.899416 25448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:30.899463 25448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:30.899507 25448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:09:30.900941 25448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:32807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:30.901243 25448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:30.901580 25448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:30.906592 25458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:30.906598 25457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:30.906800 25448 server_base.cc:1034] running on GCE node
W20260808 07:09:30.906592 25460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:30.907092 25448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:30.907343 25448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:30.908507 25448 hybrid_clock.cc:648] HybridClock initialized: now 1786172970908491 us; error 39 us; skew 500 ppm
I20260808 07:09:30.909849 25448 webserver.cc:460] Webserver started at http://127.29.82.67:35319/ using document root <none> and password file <none>
I20260808 07:09:30.910101 25448 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:30.910156 25448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:30.910291 25448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:30.911443 25448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "dd573e4609dc4df9aacfed1aa65e1d2b"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "cd8c120de857e88932a5ae6a26f7ea72"
server_key_iv: "65bf7ce405c8363eeaeacae0626caecf"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.911782 25448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "dd573e4609dc4df9aacfed1aa65e1d2b"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "cd8c120de857e88932a5ae6a26f7ea72"
server_key_iv: "65bf7ce405c8363eeaeacae0626caecf"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.913110 25448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:09:30.913910 25471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.914116 25448 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:30.914220 25448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "dd573e4609dc4df9aacfed1aa65e1d2b"
format_stamp: "Formatted at 2026-08-08 07:09:30 on dist-test-slave-rmhg"
server_key: "cd8c120de857e88932a5ae6a26f7ea72"
server_key_iv: "65bf7ce405c8363eeaeacae0626caecf"
server_key_version: "encryptionkey@0"
I20260808 07:09:30.914292 25448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:30.922405 25448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:30.922710 25448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:30.922837 25448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:30.923060 25448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:30.923385 25448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:30.923420 25448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.923448 25448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:30.923473 25448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:30.928891 25448 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:43741
I20260808 07:09:30.928958 25639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:43741 every 8 connection(s)
I20260808 07:09:30.929380 25448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:09:30.930886 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 25448
I20260808 07:09:30.931007 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:09:30.931236 30025 external_mini_cluster.cc:1428] Setting key e7a63827c27dc2a3188f84400cddc058
I20260808 07:09:30.934823 25048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.930135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:35889 (local address 127.29.82.126:32807)
0808 07:09:30.930192 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.930194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.930470 (+ 276us) server_negotiation.cc:407] Connection header received
0808 07:09:30.931101 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.931103 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.931117 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.931175 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:30.931991 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.932534 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.933611 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.933803 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.933858 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.934594 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:30.934596 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:30.934596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:30.934600 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:30.934616 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:30.934620 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:30.934675 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.934729 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.934760 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:09:30.935019 25643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.930160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:32807 (local address 127.29.82.67:35889)
0808 07:09:30.930348 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:30.930382 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:30.930978 (+ 596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:30.931253 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:30.931258 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:30.931269 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:30.931911 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.931919 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.932610 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.932611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.933538 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.933541 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.933863 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.933863 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.933973 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.934443 (+ 470us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:09:30.934443 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:30.934474 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:09:30.934496 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:30.934679 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:30.934682 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:30.934684 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:09:30.934730 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:09:30.934812 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":84,"threads_started":1}
I20260808 07:09:30.935433 25640 heartbeater.cc:347] Connected to a master server at 127.29.82.126:32807
I20260808 07:09:30.935527 25640 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:30.935706 25640 heartbeater.cc:511] Master 127.29.82.126:32807 requested a full tablet report, sending...
I20260808 07:09:30.936049 24977 ts_manager.cc:194] Registered new tserver with Master: dd573e4609dc4df9aacfed1aa65e1d2b (127.29.82.67:43741)
I20260808 07:09:30.936416 24977 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.82.67:35889
I20260808 07:09:30.943145 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:09:30.947642 25048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.944589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57308 (local address 127.29.82.126:32807)
0808 07:09:30.944644 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.944646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.944794 (+ 148us) server_negotiation.cc:407] Connection header received
0808 07:09:30.944822 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.944823 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.944838 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.944880 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:30.945065 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.945630 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.946416 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.946618 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.946682 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.947387 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:30.947388 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:30.947388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:30.947393 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:30.947408 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:30.947413 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:30.947495 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.947556 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.947575 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:09:30.949277 24977 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57308:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:09:30.950830 24977 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:09:30.957279 25652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.953192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:36393 (local address 127.0.0.1:59516)
0808 07:09:30.953416 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:30.953461 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:30.953546 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:30.953860 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:30.953863 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:30.953865 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:30.953944 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.953946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.954996 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.954998 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.956090 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.956093 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.956939 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.956940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.957024 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.957040 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 07:09:30.957105 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 07:09:30.957189 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":75,"threads_started":1}
I20260808 07:09:30.957363 25657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.953634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48274 (local address 127.29.82.67:43741)
0808 07:09:30.953809 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.953814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.953824 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:09:30.953858 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.953860 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.953873 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.953944 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:30.954048 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.955335 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.956352 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.956997 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.957088 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.957215 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.957243 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.957278 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":78,"threads_started":1}
I20260808 07:09:30.957340 25656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.953410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:43741 (local address 127.0.0.1:48274)
0808 07:09:30.953535 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:30.953544 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:30.953586 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:30.953950 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:30.953951 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:30.953953 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:30.953983 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.953984 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.955452 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.955453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.956260 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.956263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.957090 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.957091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.957143 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.957146 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:09:30.957204 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:09:30.957235 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":78,"threads_started":1}
I20260808 07:09:30.957755 25653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.953288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59516 (local address 127.29.82.66:36393)
0808 07:09:30.953690 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.953695 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.953705 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:09:30.953743 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.953745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.953762 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.953845 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:30.954066 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.954919 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.956186 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.956849 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.956911 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.957009 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.957623 (+ 614us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.957674 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":92,"threads_started":1}
I20260808 07:09:30.957770 25650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.953220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:36693 (local address 127.0.0.1:58756)
0808 07:09:30.953473 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:30.953484 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:30.953545 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:30.954141 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:30.954142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:30.954144 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:30.954177 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.954178 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.955476 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.955477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.956546 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:30.956549 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.957551 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.957553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:30.957606 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.957610 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:30.957659 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:09:30.957699 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":40,"thread_start_us":113,"threads_started":1}
I20260808 07:09:30.957809 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:30.953300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58756 (local address 127.29.82.65:36693)
0808 07:09:30.953989 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:30.953993 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:30.954002 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:09:30.954041 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:30.954042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:30.954056 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:30.954133 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:30.954303 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.955395 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.956634 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:30.957348 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:30.957414 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:30.957515 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:30.957698 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 07:09:30.957735 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":86,"threads_started":1}
I20260808 07:09:30.958413 25538 tablet_service.cc:1467] Processing CreateTablet for tablet accf4c4cdb2b481d81a60c4b76e5a25b (DEFAULT_TABLE table=test-table [id=d5119077bbaf47888905601f40c4f49a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:30.958421 25156 tablet_service.cc:1467] Processing CreateTablet for tablet accf4c4cdb2b481d81a60c4b76e5a25b (DEFAULT_TABLE table=test-table [id=d5119077bbaf47888905601f40c4f49a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:30.958518 25350 tablet_service.cc:1467] Processing CreateTablet for tablet accf4c4cdb2b481d81a60c4b76e5a25b (DEFAULT_TABLE table=test-table [id=d5119077bbaf47888905601f40c4f49a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:30.958807 25156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet accf4c4cdb2b481d81a60c4b76e5a25b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:30.958807 25538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet accf4c4cdb2b481d81a60c4b76e5a25b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:30.958858 25350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet accf4c4cdb2b481d81a60c4b76e5a25b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:30.961602 25658 tablet_bootstrap.cc:492] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010: Bootstrap starting.
I20260808 07:09:30.962007 25660 tablet_bootstrap.cc:492] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b: Bootstrap starting.
I20260808 07:09:30.962205 25658 tablet_bootstrap.cc:654] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:30.962540 25658 log.cc:824] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:30.962625 25660 tablet_bootstrap.cc:654] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:30.962926 25659 tablet_bootstrap.cc:492] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e: Bootstrap starting.
I20260808 07:09:30.962939 25660 log.cc:824] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:30.963290 25658 tablet_bootstrap.cc:492] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010: No bootstrap required, opened a new log
I20260808 07:09:30.963366 25658 ts_tablet_manager.cc:1397] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:09:30.963542 25659 tablet_bootstrap.cc:654] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:30.963693 25660 tablet_bootstrap.cc:492] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b: No bootstrap required, opened a new log
I20260808 07:09:30.963761 25660 ts_tablet_manager.cc:1397] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:09:30.963851 25659 log.cc:824] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:30.964666 25659 tablet_bootstrap.cc:492] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e: No bootstrap required, opened a new log
I20260808 07:09:30.964736 25659 ts_tablet_manager.cc:1397] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:09:30.965547 25658 raft_consensus.cc:348] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aca07dbf34badaa34d9f828112010" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 36393 } } peers { permanent_uuid: "dd573e4609dc4df9aacfed1aa65e1d2b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43741 } } peers { permanent_uuid: "1610e693c6334f25b1acfc90f63f726e" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 36693 } }
I20260808 07:09:30.965680 25658 raft_consensus.cc:374] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:30.965714 25658 raft_consensus.cc:729] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc8aca07dbf34badaa34d9f828112010, State: Initialized, Role: FOLLOWER
I20260808 07:09:30.965847 25658 consensus_queue.cc:260] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aca07dbf34badaa34d9f828112010" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 36393 } } peers { permanent_uuid: "dd573e4609dc4df9aacfed1aa65e1d2b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43741 } } peers { permanent_uuid: "1610e693c6334f25b1acfc90f63f726e" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 36693 } }
I20260808 07:09:30.966094 25658 ts_tablet_manager.cc:1428] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 07:09:30.966219 25445 heartbeater.cc:503] Master 127.29.82.126:32807 was elected leader, sending a full tablet report...
I20260808 07:09:30.966216 25660 raft_consensus.cc:348] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aca07dbf34badaa34d9f828112010" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 36393 } } peers { permanent_uuid: "dd573e4609dc4df9aacfed1aa65e1d2b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43741 } } peers { permanent_uuid: "1610e693c6334f25b1acfc90f63f726e" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 36693 } }
I20260808 07:09:30.966377 25660 raft_consensus.cc:374] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:30.966475 25660 raft_consensus.cc:729] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd573e4609dc4df9aacfed1aa65e1d2b, State: Initialized, Role: FOLLOWER
I20260808 07:09:30.966656 25660 consensus_queue.cc:260] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aca07dbf34badaa34d9f828112010" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 36393 } } peers { permanent_uuid: "dd573e4609dc4df9aacfed1aa65e1d2b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43741 } } peers { permanent_uuid: "1610e693c6334f25b1acfc90f63f726e" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 36693 } }
I20260808 07:09:30.966905 25660 ts_tablet_manager.cc:1428] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:09:30.967063 25640 heartbeater.cc:503] Master 127.29.82.126:32807 was elected leader, sending a full tablet report...
I20260808 07:09:30.967221 25659 raft_consensus.cc:348] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aca07dbf34badaa34d9f828112010" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 36393 } } peers { permanent_uuid: "dd573e4609dc4df9aacfed1aa65e1d2b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43741 } } peers { permanent_uuid: "1610e693c6334f25b1acfc90f63f726e" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 36693 } }
I20260808 07:09:30.967370 25659 raft_consensus.cc:374] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:30.967412 25659 raft_consensus.cc:729] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1610e693c6334f25b1acfc90f63f726e, State: Initialized, Role: FOLLOWER
I20260808 07:09:30.967547 25659 consensus_queue.cc:260] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aca07dbf34badaa34d9f828112010" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 36393 } } peers { permanent_uuid: "dd573e4609dc4df9aacfed1aa65e1d2b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43741 } } peers { permanent_uuid: "1610e693c6334f25b1acfc90f63f726e" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 36693 } }
I20260808 07:09:30.967793 25659 ts_tablet_manager.cc:1428] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:09:30.967829 25256 heartbeater.cc:503] Master 127.29.82.126:32807 was elected leader, sending a full tablet report...
W20260808 07:09:31.061594 25446 tablet.cc:2369] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:09:31.145037 25665 raft_consensus.cc:482] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:31.145211 25665 raft_consensus.cc:504] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aca07dbf34badaa34d9f828112010" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 36393 } } peers { permanent_uuid: "dd573e4609dc4df9aacfed1aa65e1d2b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43741 } } peers { permanent_uuid: "1610e693c6334f25b1acfc90f63f726e" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 36693 } }
I20260808 07:09:31.145614 25665 leader_election.cc:288] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd573e4609dc4df9aacfed1aa65e1d2b (127.29.82.67:43741), 1610e693c6334f25b1acfc90f63f726e (127.29.82.65:36693)
I20260808 07:09:31.148281 25657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:31.145872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:33639 (local address 127.29.82.67:43741)
0808 07:09:31.145926 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:31.145929 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:31.145941 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:09:31.145973 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:31.145974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:31.145984 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:31.146040 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:31.146177 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:31.146665 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:31.147605 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:31.147977 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:31.148046 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:31.148055 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:31.148177 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 07:09:31.148213 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 07:09:31.148281 25447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:31.145797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:43741 (local address 127.29.82.66:33639)
0808 07:09:31.145844 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:31.145857 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:31.145907 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:31.146047 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:31.146048 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:31.146049 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:31.146121 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:31.146123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:31.146737 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:31.146739 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:31.147478 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:31.147480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:31.148054 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:31.148055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:31.148118 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:31.148122 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:31.148166 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:09:31.148206 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23,"mutex_wait_us":1}
I20260808 07:09:31.148517 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:31.145903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:48747 (local address 127.29.82.65:36693)
0808 07:09:31.145959 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:31.145961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:31.146185 (+ 224us) server_negotiation.cc:407] Connection header received
0808 07:09:31.146223 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:31.146225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:31.146239 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:31.146286 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:31.146416 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:31.146880 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:31.147806 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:31.148160 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:31.148222 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:31.148229 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:31.148391 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 07:09:31.148439 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 07:09:31.148758 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:31.145802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:36693 (local address 127.29.82.66:48747)
0808 07:09:31.146109 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:31.146118 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:31.146178 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:31.146287 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:31.146288 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:31.146290 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:31.146360 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:31.146361 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:31.146949 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:31.146950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:31.147731 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:31.147733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:31.148240 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:31.148241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:31.148306 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:31.148310 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:31.148607 (+ 297us) client_negotiation.cc:240] Negotiation successful
0808 07:09:31.148679 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":134,"thread_start_us":100,"threads_started":1}
I20260808 07:09:31.148705 25564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "accf4c4cdb2b481d81a60c4b76e5a25b" candidate_uuid: "bc8aca07dbf34badaa34d9f828112010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd573e4609dc4df9aacfed1aa65e1d2b" is_pre_election: true
I20260808 07:09:31.148865 25564 raft_consensus.cc:2454] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc8aca07dbf34badaa34d9f828112010 in term 0.
I20260808 07:09:31.149087 25281 leader_election.cc:302] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc8aca07dbf34badaa34d9f828112010, dd573e4609dc4df9aacfed1aa65e1d2b; no voters:
I20260808 07:09:31.149223 25189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "accf4c4cdb2b481d81a60c4b76e5a25b" candidate_uuid: "bc8aca07dbf34badaa34d9f828112010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1610e693c6334f25b1acfc90f63f726e" is_pre_election: true
I20260808 07:09:31.149286 25665 raft_consensus.cc:2781] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:09:31.149355 25665 raft_consensus.cc:482] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:09:31.149384 25665 raft_consensus.cc:3037] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:31.149375 25189 raft_consensus.cc:2454] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc8aca07dbf34badaa34d9f828112010 in term 0.
I20260808 07:09:31.150166 25665 raft_consensus.cc:504] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aca07dbf34badaa34d9f828112010" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 36393 } } peers { permanent_uuid: "dd573e4609dc4df9aacfed1aa65e1d2b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43741 } } peers { permanent_uuid: "1610e693c6334f25b1acfc90f63f726e" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 36693 } }
I20260808 07:09:31.150285 25665 leader_election.cc:288] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [CANDIDATE]: Term 1 election: Requested vote from peers dd573e4609dc4df9aacfed1aa65e1d2b (127.29.82.67:43741), 1610e693c6334f25b1acfc90f63f726e (127.29.82.65:36693)
I20260808 07:09:31.150437 25189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "accf4c4cdb2b481d81a60c4b76e5a25b" candidate_uuid: "bc8aca07dbf34badaa34d9f828112010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1610e693c6334f25b1acfc90f63f726e"
I20260808 07:09:31.150461 25564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "accf4c4cdb2b481d81a60c4b76e5a25b" candidate_uuid: "bc8aca07dbf34badaa34d9f828112010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd573e4609dc4df9aacfed1aa65e1d2b"
I20260808 07:09:31.150509 25189 raft_consensus.cc:3037] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:31.150539 25564 raft_consensus.cc:3037] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:31.151206 25189 raft_consensus.cc:2454] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc8aca07dbf34badaa34d9f828112010 in term 1.
I20260808 07:09:31.151280 25564 raft_consensus.cc:2454] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc8aca07dbf34badaa34d9f828112010 in term 1.
I20260808 07:09:31.151404 25279 leader_election.cc:302] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1610e693c6334f25b1acfc90f63f726e, bc8aca07dbf34badaa34d9f828112010; no voters:
I20260808 07:09:31.151543 25665 raft_consensus.cc:2781] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:31.151700 25665 raft_consensus.cc:686] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [term 1 LEADER]: Becoming Leader. State: Replica: bc8aca07dbf34badaa34d9f828112010, State: Running, Role: LEADER
I20260808 07:09:31.151793 25665 consensus_queue.cc:237] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aca07dbf34badaa34d9f828112010" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 36393 } } peers { permanent_uuid: "dd573e4609dc4df9aacfed1aa65e1d2b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43741 } } peers { permanent_uuid: "1610e693c6334f25b1acfc90f63f726e" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 36693 } }
I20260808 07:09:31.152590 24976 catalog_manager.cc:5495] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc8aca07dbf34badaa34d9f828112010 (127.29.82.66). New cstate: current_term: 1 leader_uuid: "bc8aca07dbf34badaa34d9f828112010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8aca07dbf34badaa34d9f828112010" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 36393 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd573e4609dc4df9aacfed1aa65e1d2b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1610e693c6334f25b1acfc90f63f726e" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 36693 } health_report { overall_health: UNKNOWN } } }
W20260808 07:09:31.179951 25642 tablet.cc:2369] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:09:31.183612 25653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:31.181509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59522 (local address 127.29.82.66:36393)
0808 07:09:31.181566 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:31.181568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:31.181578 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:09:31.181634 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:31.181635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:31.181653 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:31.181713 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:09:31.181829 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:31.182296 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:31.182977 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:31.183154 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:31.183197 (+ 43us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:31.183300 (+ 103us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:09:31.183385 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:09:31.183450 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:31.183487 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 07:09:31.183495 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:09:31.185473 25189 raft_consensus.cc:1261] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e [term 1 FOLLOWER]: Refusing update from remote peer bc8aca07dbf34badaa34d9f828112010: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:31.185473 25564 raft_consensus.cc:1261] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b [term 1 FOLLOWER]: Refusing update from remote peer bc8aca07dbf34badaa34d9f828112010: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:31.185843 25669 consensus_queue.cc:1035] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1610e693c6334f25b1acfc90f63f726e" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 36693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:31.185976 25665 consensus_queue.cc:1035] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd573e4609dc4df9aacfed1aa65e1d2b" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 43741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:31.188764 25675 mvcc.cc:205] Tried to move back new op lower bound from 7316164489972789248 to 7316164489838309376. Current Snapshot: MvccSnapshot[applied={T|T < 7316164489972789248}]
I20260808 07:09:31.189368 25676 mvcc.cc:205] Tried to move back new op lower bound from 7316164489972789248 to 7316164489838309376. Current Snapshot: MvccSnapshot[applied={T|T < 7316164489972789248 or (T in {7316164489972789248})}]
I20260808 07:09:31.191313 24977 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:31.191424 24977 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:31.192157 24977 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 42595a155e7440d2bbef26e79abde37f: Sending DeleteTablet for 3 replicas of tablet accf4c4cdb2b481d81a60c4b76e5a25b
I20260808 07:09:31.192476 25350 tablet_service.cc:1514] Processing DeleteTablet for tablet accf4c4cdb2b481d81a60c4b76e5a25b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:31 UTC) from {username='slave'} at 127.0.0.1:59516
I20260808 07:09:31.192534 25538 tablet_service.cc:1514] Processing DeleteTablet for tablet accf4c4cdb2b481d81a60c4b76e5a25b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:31 UTC) from {username='slave'} at 127.0.0.1:48274
I20260808 07:09:31.192631 25156 tablet_service.cc:1514] Processing DeleteTablet for tablet accf4c4cdb2b481d81a60c4b76e5a25b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:31 UTC) from {username='slave'} at 127.0.0.1:58756
I20260808 07:09:31.192744 25691 tablet_replica.cc:330] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b: stopping tablet replica
I20260808 07:09:31.192795 25690 tablet_replica.cc:330] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010: stopping tablet replica
I20260808 07:09:31.192831 25691 raft_consensus.cc:2229] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:31.193017 25692 tablet_replica.cc:330] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e: stopping tablet replica
I20260808 07:09:31.193018 25691 raft_consensus.cc:2258] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:31.193192 25692 raft_consensus.cc:2229] T accf4c4cdb2b481d81a60c4b76e5a25b P 1610e693c6334f25b1acfc90f63f726e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:31.193225 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 25061
I20260808 07:09:31.194061 25691 ts_tablet_manager.cc:1905] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:31.195741 25691 ts_tablet_manager.cc:1918] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:31.195816 25691 log.cc:1196] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/accf4c4cdb2b481d81a60c4b76e5a25b
I20260808 07:09:31.196162 25691 ts_tablet_manager.cc:1939] T accf4c4cdb2b481d81a60c4b76e5a25b P dd573e4609dc4df9aacfed1aa65e1d2b: Deleting consensus metadata
I20260808 07:09:31.196631 24961 catalog_manager.cc:4841] TS dd573e4609dc4df9aacfed1aa65e1d2b (127.29.82.67:43741): tablet accf4c4cdb2b481d81a60c4b76e5a25b (table test-table [id=d5119077bbaf47888905601f40c4f49a]) successfully deleted
I20260808 07:09:31.192924 25690 raft_consensus.cc:2229] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:09:31.202279 25690 raft_consensus.cc:2258] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:31.203143 25690 ts_tablet_manager.cc:1905] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:31.205236 25690 ts_tablet_manager.cc:1918] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:31.205341 25690 log.cc:1196] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/accf4c4cdb2b481d81a60c4b76e5a25b
I20260808 07:09:31.205896 25690 ts_tablet_manager.cc:1939] T accf4c4cdb2b481d81a60c4b76e5a25b P bc8aca07dbf34badaa34d9f828112010: Deleting consensus metadata
I20260808 07:09:31.209764 24961 catalog_manager.cc:4841] TS bc8aca07dbf34badaa34d9f828112010 (127.29.82.66:36393): tablet accf4c4cdb2b481d81a60c4b76e5a25b (table test-table [id=d5119077bbaf47888905601f40c4f49a]) successfully deleted
W20260808 07:09:31.211139 24957 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:36693 (error 108)
I20260808 07:09:31.211683 25650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:31.211542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:36693 (local address 127.0.0.1:58764)
0808 07:09:31.211599 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:31.211645 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:36693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 07:09:31.211725 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 25260
W20260808 07:09:31.220234 24957 catalog_manager.cc:4584] TS 1610e693c6334f25b1acfc90f63f726e (127.29.82.65:36693): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet accf4c4cdb2b481d81a60c4b76e5a25b: Network error: Client connection negotiation failed: client connection to 127.29.82.65:36693: connect: Connection refused (error 111)
I20260808 07:09:31.224349 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 25448
I20260808 07:09:31.235410 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 24935
2026-08-08T07:09:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (843 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:31 dist-test-slave-rmhg krb5kdc[25697](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:31 dist-test-slave-rmhg krb5kdc[25697](info): set up 2 sockets
Aug 08 07:09:31 dist-test-slave-rmhg krb5kdc[25697](info): commencing operation
krb5kdc: starting...
W20260808 07:09:32.360996 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:32 dist-test-slave-rmhg krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:09:32.485037 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:35151
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:35151
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:32.570097 25714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:32.570330 25714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:32.570356 25714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:32.571619 25714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:32.571671 25714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:32.571686 25714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:32.571697 25714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:32.571708 25714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:32.573359 25714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:35151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:35151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:32.573622 25714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:32.573856 25714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:32.578943 25729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:32.578944 25725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:32.578972 25714 server_base.cc:1034] running on GCE node
W20260808 07:09:32.578943 25726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:32.579445 25714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:32.579751 25714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:32.580895 25714 hybrid_clock.cc:648] HybridClock initialized: now 1786172972580879 us; error 38 us; skew 500 ppm
Aug 08 07:09:32 dist-test-slave-rmhg krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172972, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:32.583573 25714 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:09:32.584022 25714 webserver.cc:460] Webserver started at http://127.29.82.126:44307/ using document root <none> and password file <none>
I20260808 07:09:32.584236 25714 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:32.584278 25714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:32.584378 25714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:32.585538 25714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "35092274b6634172a4851b3eb1813fc7"
format_stamp: "Formatted at 2026-08-08 07:09:32 on dist-test-slave-rmhg"
server_key: "1b8b046babf762b2c658360c2893ab71"
server_key_iv: "ed21daeaf16f1b9aea834be3a14a53fc"
server_key_version: "encryptionkey@0"
I20260808 07:09:32.585860 25714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "35092274b6634172a4851b3eb1813fc7"
format_stamp: "Formatted at 2026-08-08 07:09:32 on dist-test-slave-rmhg"
server_key: "1b8b046babf762b2c658360c2893ab71"
server_key_iv: "ed21daeaf16f1b9aea834be3a14a53fc"
server_key_version: "encryptionkey@0"
I20260808 07:09:32.587162 25714 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:32.587922 25740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:32.588096 25714 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:32.588183 25714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "35092274b6634172a4851b3eb1813fc7"
format_stamp: "Formatted at 2026-08-08 07:09:32 on dist-test-slave-rmhg"
server_key: "1b8b046babf762b2c658360c2893ab71"
server_key_iv: "ed21daeaf16f1b9aea834be3a14a53fc"
server_key_version: "encryptionkey@0"
I20260808 07:09:32.588250 25714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:32.610117 25714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:32.612283 25714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:32.612406 25714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:32.616257 25714 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:35151
I20260808 07:09:32.616328 25811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:35151 every 8 connection(s)
I20260808 07:09:32.616658 25714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:32.617667 25812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:32.620077 25812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7: Bootstrap starting.
I20260808 07:09:32.620657 25812 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:32.620934 25812 log.cc:824] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:32.620944 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 25714
I20260808 07:09:32.621042 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:32.621253 30025 external_mini_cluster.cc:1428] Setting key 31a12e4181dd4898ec721c2602b9815b
I20260808 07:09:32.621694 25812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7: No bootstrap required, opened a new log
I20260808 07:09:32.623804 25812 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35092274b6634172a4851b3eb1813fc7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35151 } }
I20260808 07:09:32.623981 25812 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:32.624019 25812 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35092274b6634172a4851b3eb1813fc7, State: Initialized, Role: FOLLOWER
I20260808 07:09:32.624148 25812 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35092274b6634172a4851b3eb1813fc7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35151 } }
I20260808 07:09:32.624228 25812 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:32.624269 25812 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:32.624316 25812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:32.624879 25812 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35092274b6634172a4851b3eb1813fc7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35151 } }
I20260808 07:09:32.624992 25812 leader_election.cc:302] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35092274b6634172a4851b3eb1813fc7; no voters:
I20260808 07:09:32.625195 25812 leader_election.cc:288] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:32.625219 25821 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:32.625335 25821 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [term 1 LEADER]: Becoming Leader. State: Replica: 35092274b6634172a4851b3eb1813fc7, State: Running, Role: LEADER
I20260808 07:09:32.625422 25821 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35092274b6634172a4851b3eb1813fc7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35151 } }
I20260808 07:09:32.625483 25812 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:32.625762 25821 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35092274b6634172a4851b3eb1813fc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35092274b6634172a4851b3eb1813fc7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35151 } } }
I20260808 07:09:32.625833 25821 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:32.625969 25821 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35092274b6634172a4851b3eb1813fc7. Latest consensus state: current_term: 1 leader_uuid: "35092274b6634172a4851b3eb1813fc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35092274b6634172a4851b3eb1813fc7" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35151 } } }
I20260808 07:09:32.626027 25821 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7 [sys.catalog]: This master's current role is: LEADER
W20260808 07:09:32.627228 25842 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:09:32.627285 25842 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:09:32.627331 25827 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:32.627496 25827 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:32.628898 25827 catalog_manager.cc:1347] Generated new cluster ID: 4d8c8cf546f34e7b87404e68d4ab6dbc
I20260808 07:09:32.628947 25827 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:09:32 dist-test-slave-rmhg krb5kdc[25697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:09:32.633483 25819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:32.621739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37196 (local address 127.29.82.126:35151)
0808 07:09:32.621894 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:32.621903 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:32.621930 (+ 27us) server_negotiation.cc:407] Connection header received
0808 07:09:32.622894 (+ 964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:32.622903 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:32.622956 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:32.623092 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:32.623878 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:32.625250 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:32.626288 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:32.626939 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:32.627063 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:32.629897 (+ 2834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:32.629902 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:32.629902 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:32.629915 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:32.631840 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:32.632222 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:32.632225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:32.632226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:32.632339 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:32.632516 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:32.632516 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:32.632517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:32.632841 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:32.633004 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:32.633079 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 07:09:32.633252 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":73,"threads_started":1}
I20260808 07:09:32.647754 25827 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:32.648324 25827 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:32.651849 25827 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7: Generated new TSK 0
I20260808 07:09:32.652009 25827 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.82.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
Entry for principal kudu/127.29.82.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab.
I20260808 07:09:32.679675 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:35151
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:32.766161 25851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:32.766369 25851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:32.766392 25851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:32.767482 25851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:32.767514 25851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:32.767539 25851 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:09:32.768930 25851 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.65.keytab
--principal=kudu/127.29.82.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:35151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:32.769133 25851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:32.769363 25851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:32.774340 25864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:32.774326 25860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:32.774319 25859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:32.774528 25851 server_base.cc:1034] running on GCE node
I20260808 07:09:32.774832 25851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:32.775060 25851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:32.776233 25851 hybrid_clock.cc:648] HybridClock initialized: now 1786172972776218 us; error 34 us; skew 500 ppm
Aug 08 07:09:32 dist-test-slave-rmhg krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172972, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:32.778815 25851 init.cc:377] Logged in from keytab as kudu/127.29.82.65@KRBTEST.COM (short username kudu)
I20260808 07:09:32.779244 25851 webserver.cc:460] Webserver started at http://127.29.82.65:38825/ using document root <none> and password file <none>
I20260808 07:09:32.779448 25851 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:32.779496 25851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:32.779636 25851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:32.780699 25851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "3936f2e2a6f14ed3ade6486acfb2f36d"
format_stamp: "Formatted at 2026-08-08 07:09:32 on dist-test-slave-rmhg"
server_key: "9a5f7daea40f7ecc43bb02f84aed2f67"
server_key_iv: "4386eaea80ce1577c47c6434f20195fa"
server_key_version: "encryptionkey@0"
I20260808 07:09:32.781038 25851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "3936f2e2a6f14ed3ade6486acfb2f36d"
format_stamp: "Formatted at 2026-08-08 07:09:32 on dist-test-slave-rmhg"
server_key: "9a5f7daea40f7ecc43bb02f84aed2f67"
server_key_iv: "4386eaea80ce1577c47c6434f20195fa"
server_key_version: "encryptionkey@0"
I20260808 07:09:32.782410 25851 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:32.783224 25874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:32.783454 25851 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:32.783556 25851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "3936f2e2a6f14ed3ade6486acfb2f36d"
format_stamp: "Formatted at 2026-08-08 07:09:32 on dist-test-slave-rmhg"
server_key: "9a5f7daea40f7ecc43bb02f84aed2f67"
server_key_iv: "4386eaea80ce1577c47c6434f20195fa"
server_key_version: "encryptionkey@0"
I20260808 07:09:32.783631 25851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:32.802812 25851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:32.804999 25851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:32.805191 25851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:32.805457 25851 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:32.805811 25851 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:32.805848 25851 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:32.805879 25851 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:32.805902 25851 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:32.811491 25851 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:44433
I20260808 07:09:32.811553 26032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:44433 every 8 connection(s)
I20260808 07:09:32.811892 25851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:09:32.816020 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 25851
I20260808 07:09:32.816128 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:09:32.816299 30025 external_mini_cluster.cc:1428] Setting key b07557848e2554e6699128d260c7054d
Aug 08 07:09:32 dist-test-slave-rmhg krb5kdc[25697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172972, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.65@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:09:32.821622 25819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:32.812662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:44355 (local address 127.29.82.126:35151)
0808 07:09:32.812727 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:32.812730 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:32.812919 (+ 189us) server_negotiation.cc:407] Connection header received
0808 07:09:32.813472 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:32.813474 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:32.813486 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:32.813542 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:32.814561 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:32.815064 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:32.816075 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:32.816327 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:32.816385 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:32.818717 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:32.818719 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:32.818719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:32.818729 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:32.820017 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:32.820468 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:32.820469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:32.820469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:32.820551 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:32.820835 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:32.820836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:32.820837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:32.820971 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:32.821037 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:32.821468 (+ 431us) server_negotiation.cc:299] Negotiation successful
0808 07:09:32.821549 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 07:09:32.821830 26035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:32.812610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:35151 (local address 127.29.82.65:44355)
0808 07:09:32.812792 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:32.812831 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:32.813373 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:32.813653 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:32.813657 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:32.814246 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:32.814454 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:32.814458 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:32.815160 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:32.815161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:32.815985 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:32.815987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:32.816454 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:32.816455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:32.816563 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:32.817205 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:32.817216 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:32.818589 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:32.820101 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:32.820110 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:32.820113 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:32.820399 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:32.820608 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:32.820608 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:32.820609 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:32.820745 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:32.821062 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:32.821072 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:32.821277 (+ 205us) client_negotiation.cc:769] Sending connection context
0808 07:09:32.821401 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 07:09:32.821584 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":88,"threads_started":1}
I20260808 07:09:32.822337 26033 heartbeater.cc:347] Connected to a master server at 127.29.82.126:35151
I20260808 07:09:32.822466 26033 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:32.822682 26033 heartbeater.cc:511] Master 127.29.82.126:35151 requested a full tablet report, sending...
I20260808 07:09:32.823252 25758 ts_manager.cc:194] Registered new tserver with Master: 3936f2e2a6f14ed3ade6486acfb2f36d (127.29.82.65:44433)
I20260808 07:09:32.823900 25758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.65@KRBTEST.COM'} at 127.29.82.65:44355
WARNING: no policy specified for kudu/127.29.82.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
Entry for principal kudu/127.29.82.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab.
I20260808 07:09:32.843256 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:35151
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:32.927019 26042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:32.927274 26042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:32.927312 26042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:32.928550 26042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:32.928601 26042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:32.928638 26042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:09:32.930243 26042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.66.keytab
--principal=kudu/127.29.82.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:35151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:32.930526 26042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:32.930765 26042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:32.935922 26051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:32.935997 26053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:32.936143 26042 server_base.cc:1034] running on GCE node
W20260808 07:09:32.936198 26048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:32.936419 26042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:32.936694 26042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:32.937861 26042 hybrid_clock.cc:648] HybridClock initialized: now 1786172972937837 us; error 34 us; skew 500 ppm
Aug 08 07:09:32 dist-test-slave-rmhg krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172972, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:32.940543 26042 init.cc:377] Logged in from keytab as kudu/127.29.82.66@KRBTEST.COM (short username kudu)
I20260808 07:09:32.941041 26042 webserver.cc:460] Webserver started at http://127.29.82.66:35007/ using document root <none> and password file <none>
I20260808 07:09:32.941306 26042 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:32.941362 26042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:32.941499 26042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:32.942555 26042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "bbd04186ebec4e528e97f13a64258c63"
format_stamp: "Formatted at 2026-08-08 07:09:32 on dist-test-slave-rmhg"
server_key: "bac32a3978f21b8243dcde82525cbbfb"
server_key_iv: "b14c347294847893459e354dfb3bce04"
server_key_version: "encryptionkey@0"
I20260808 07:09:32.942885 26042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "bbd04186ebec4e528e97f13a64258c63"
format_stamp: "Formatted at 2026-08-08 07:09:32 on dist-test-slave-rmhg"
server_key: "bac32a3978f21b8243dcde82525cbbfb"
server_key_iv: "b14c347294847893459e354dfb3bce04"
server_key_version: "encryptionkey@0"
I20260808 07:09:32.944191 26042 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:32.945024 26064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:32.945266 26042 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:32.945372 26042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "bbd04186ebec4e528e97f13a64258c63"
format_stamp: "Formatted at 2026-08-08 07:09:32 on dist-test-slave-rmhg"
server_key: "bac32a3978f21b8243dcde82525cbbfb"
server_key_iv: "b14c347294847893459e354dfb3bce04"
server_key_version: "encryptionkey@0"
I20260808 07:09:32.945447 26042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:32.973704 26042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:32.975950 26042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:32.976107 26042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:32.976346 26042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:32.976678 26042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:32.976714 26042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:32.976745 26042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:32.976763 26042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:32.982714 26042 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:32923
I20260808 07:09:32.982761 26225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:32923 every 8 connection(s)
I20260808 07:09:32.983098 26042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:09:32.989367 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 26042
Aug 08 07:09:32 dist-test-slave-rmhg krb5kdc[25697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172972, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.66@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:09:32.989483 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:09:32.989701 30025 external_mini_cluster.cc:1428] Setting key 90e9001352d831a869f6f4a8787691d1
I20260808 07:09:32.992803 25819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:32.983817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:34589 (local address 127.29.82.126:35151)
0808 07:09:32.983901 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:32.983904 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:32.984083 (+ 179us) server_negotiation.cc:407] Connection header received
0808 07:09:32.984579 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:32.984581 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:32.984590 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:32.984645 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:32.985701 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:32.986226 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:32.987312 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:32.987528 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:32.987627 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:32.990008 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:32.990010 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:32.990010 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:32.990019 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:32.991372 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:32.991815 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:32.991816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:32.991816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:32.991872 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:32.992125 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:32.992126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:32.992126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:32.992247 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:32.992307 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:32.992627 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 07:09:32.992712 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 07:09:32.993005 26229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:32.983793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:35151 (local address 127.29.82.66:34589)
0808 07:09:32.983953 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:32.983992 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:32.984504 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:32.984706 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:32.984710 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:32.985364 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:32.985577 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:32.985583 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:32.986306 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:32.986306 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:32.987221 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:32.987224 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:32.987658 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:32.987659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:32.987782 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:32.988274 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:32.988283 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:32.989912 (+ 1629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:32.991446 (+ 1534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:32.991455 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:32.991458 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:32.991749 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:32.991926 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:32.991927 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:32.991927 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:32.992070 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:32.992311 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:32.992319 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:32.992497 (+ 178us) client_negotiation.cc:769] Sending connection context
0808 07:09:32.992595 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 07:09:32.992775 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":84,"threads_started":1}
I20260808 07:09:32.993499 26226 heartbeater.cc:347] Connected to a master server at 127.29.82.126:35151
I20260808 07:09:32.993592 26226 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:32.993763 26226 heartbeater.cc:511] Master 127.29.82.126:35151 requested a full tablet report, sending...
I20260808 07:09:32.994141 25758 ts_manager.cc:194] Registered new tserver with Master: bbd04186ebec4e528e97f13a64258c63 (127.29.82.66:32923)
I20260808 07:09:32.994505 25758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.66@KRBTEST.COM'} at 127.29.82.66:34589
WARNING: no policy specified for kudu/127.29.82.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
Entry for principal kudu/127.29.82.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab.
I20260808 07:09:33.016723 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:35151
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:33.099174 26238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:33.099382 26238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:33.099406 26238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:33.100497 26238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:33.100533 26238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:33.100557 26238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:09:33.102000 26238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.67.keytab
--principal=kudu/127.29.82.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:35151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:33.102226 26238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:33.102427 26238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:33.107336 26254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:33.107396 26251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:33.107416 26250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:33.107627 26238 server_base.cc:1034] running on GCE node
I20260808 07:09:33.107846 26238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:33.108084 26238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:33.109238 26238 hybrid_clock.cc:648] HybridClock initialized: now 1786172973109220 us; error 31 us; skew 500 ppm
Aug 08 07:09:33 dist-test-slave-rmhg krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172973, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:33.111706 26238 init.cc:377] Logged in from keytab as kudu/127.29.82.67@KRBTEST.COM (short username kudu)
I20260808 07:09:33.112181 26238 webserver.cc:460] Webserver started at http://127.29.82.67:33365/ using document root <none> and password file <none>
I20260808 07:09:33.112394 26238 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:33.112438 26238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:33.112566 26238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:33.113677 26238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "85f64cb44e26461caf381690f4a4255f"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "3834ddafeb097eee1af9515430441e85"
server_key_iv: "c13aa470a4d1e509f484ea06f55c442c"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.114005 26238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "85f64cb44e26461caf381690f4a4255f"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "3834ddafeb097eee1af9515430441e85"
server_key_iv: "c13aa470a4d1e509f484ea06f55c442c"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.115315 26238 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:09:33.116099 26266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:33.116263 26238 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:33.116353 26238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "85f64cb44e26461caf381690f4a4255f"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "3834ddafeb097eee1af9515430441e85"
server_key_iv: "c13aa470a4d1e509f484ea06f55c442c"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.116420 26238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:33.130777 26238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:33.132756 26238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:33.132886 26238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:33.133131 26238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:33.133586 26238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:33.133625 26238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:33.133649 26238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:33.133672 26238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:33.139345 26238 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:38141
I20260808 07:09:33.139400 26429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:38141 every 8 connection(s)
I20260808 07:09:33.139714 26238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:09:33.142835 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 26238
I20260808 07:09:33.142935 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:09:33.143090 30025 external_mini_cluster.cc:1428] Setting key 121ef785c12354c430d37b7e1a6e34af
Aug 08 07:09:33 dist-test-slave-rmhg krb5kdc[25697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172973, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.67@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:09:33.149480 25819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.140491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:37805 (local address 127.29.82.126:35151)
0808 07:09:33.140555 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.140558 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.140738 (+ 180us) server_negotiation.cc:407] Connection header received
0808 07:09:33.141298 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.141299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.141313 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.141365 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:33.142344 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.142885 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.144095 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.144367 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.144437 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.146665 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:33.146667 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:33.146667 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:33.146675 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:33.147996 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:33.148488 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:33.148488 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:33.148489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:33.148562 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:33.148787 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:33.148788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:33.148788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:33.148906 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:33.148962 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.149284 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.149375 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 07:09:33.149622 26432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.140412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:35151 (local address 127.29.82.67:37805)
0808 07:09:33.140602 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:33.140647 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:33.141191 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:33.141436 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:33.141440 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:33.142039 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:33.142244 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.142249 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.142970 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.142970 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.144007 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.144009 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.144464 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.144466 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.144624 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.145093 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:09:33.145102 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:33.146571 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:33.148075 (+ 1504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:33.148082 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:33.148084 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:33.148407 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:33.148619 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:09:33.148620 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:09:33.148620 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:09:33.148730 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:09:33.148968 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:33.148975 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:33.149113 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 07:09:33.149237 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 07:09:33.149403 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":70,"threads_started":1}
I20260808 07:09:33.150028 26430 heartbeater.cc:347] Connected to a master server at 127.29.82.126:35151
I20260808 07:09:33.150120 26430 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:33.150291 26430 heartbeater.cc:511] Master 127.29.82.126:35151 requested a full tablet report, sending...
I20260808 07:09:33.150674 25758 ts_manager.cc:194] Registered new tserver with Master: 85f64cb44e26461caf381690f4a4255f (127.29.82.67:38141)
I20260808 07:09:33.151182 25758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.82.67@KRBTEST.COM'} at 127.29.82.67:37805
I20260808 07:09:33.154810 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:09:33.161568 25819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.156137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37206 (local address 127.29.82.126:35151)
0808 07:09:33.156174 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.156176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.156250 (+ 74us) server_negotiation.cc:407] Connection header received
0808 07:09:33.156314 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.156314 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.156322 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.156359 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:33.156903 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.157423 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.158162 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.158347 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.158400 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.159561 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:33.159562 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:33.159563 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:33.159568 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:33.160621 (+ 1053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:33.160925 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:33.160925 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:33.160926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:33.160969 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:33.161098 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:33.161098 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:33.161099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:33.161263 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:33.161340 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.161425 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.161482 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:09:33.163061 25758 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37206:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:09:33.164598 25758 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:09:33.171145 26445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.166962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:32923 (local address 127.0.0.1:44988)
0808 07:09:33.167281 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:33.167327 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:33.167397 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:33.167891 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:33.167892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:33.167894 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:33.167942 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.167944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.168838 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.168839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.170145 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.170149 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.170837 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.170838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.170920 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.170944 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 07:09:33.171009 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 07:09:33.171063 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":50,"threads_started":1}
I20260808 07:09:33.171365 26451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.166962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:38141 (local address 127.0.0.1:51592)
0808 07:09:33.167281 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:33.167327 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:33.167397 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:33.167990 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:33.167991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:33.167993 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:33.168032 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.168033 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.169241 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.169242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.170111 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.170114 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.171148 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.171148 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.171207 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.171211 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:33.171262 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 07:09:33.171301 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":2,"thread_start_us":91,"threads_started":1}
I20260808 07:09:33.171387 26447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.167076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44988 (local address 127.29.82.66:32923)
0808 07:09:33.167546 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.167550 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.167559 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:09:33.167620 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.167621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.167637 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.167704 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:33.168025 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.168746 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.170257 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.170751 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.170817 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.170880 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.171272 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.171315 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":99,"threads_started":1}
I20260808 07:09:33.171732 26446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.167153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:44433 (local address 127.0.0.1:32860)
0808 07:09:33.167295 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:33.167327 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:33.167397 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:33.167702 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:33.167705 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:33.167708 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:33.167782 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.167784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.169082 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.169083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.170170 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.170171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.171518 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.171519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.171576 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.171579 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:09:33.171628 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:09:33.171669 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":2,"thread_start_us":67,"threads_started":1}
I20260808 07:09:33.171797 26452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.167301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32860 (local address 127.29.82.65:44433)
0808 07:09:33.167510 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.167515 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.167525 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:09:33.167594 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.167596 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.167614 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.167694 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:33.167851 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.168976 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.170232 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.170931 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.171008 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.171075 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.171666 (+ 591us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.171717 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":91,"threads_started":1}
I20260808 07:09:33.171998 26449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.167137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51592 (local address 127.29.82.67:38141)
0808 07:09:33.167846 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.167850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.167860 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:09:33.167896 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.167897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.167911 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.167984 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:33.168105 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.169116 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.170190 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.170931 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.171008 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.171067 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.171877 (+ 810us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.171922 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":669,"thread_start_us":78,"threads_started":1}
I20260808 07:09:33.172134 26128 tablet_service.cc:1467] Processing CreateTablet for tablet e996319167624194b650d4c40cad139d (DEFAULT_TABLE table=test-table [id=0d7ef9f482f543d2af01952717c8ec46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:33.172448 25941 tablet_service.cc:1467] Processing CreateTablet for tablet e996319167624194b650d4c40cad139d (DEFAULT_TABLE table=test-table [id=0d7ef9f482f543d2af01952717c8ec46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:33.172513 26128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e996319167624194b650d4c40cad139d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:33.172722 25941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e996319167624194b650d4c40cad139d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:33.172652 26335 tablet_service.cc:1467] Processing CreateTablet for tablet e996319167624194b650d4c40cad139d (DEFAULT_TABLE table=test-table [id=0d7ef9f482f543d2af01952717c8ec46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:33.172961 26335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e996319167624194b650d4c40cad139d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:33.175274 26453 tablet_bootstrap.cc:492] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d: Bootstrap starting.
I20260808 07:09:33.175935 26453 tablet_bootstrap.cc:654] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:33.176205 26455 tablet_bootstrap.cc:492] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63: Bootstrap starting.
I20260808 07:09:33.176466 26456 tablet_bootstrap.cc:492] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f: Bootstrap starting.
I20260808 07:09:33.176510 26453 log.cc:824] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:33.176908 26455 tablet_bootstrap.cc:654] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:33.177088 26456 tablet_bootstrap.cc:654] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:33.177479 26453 tablet_bootstrap.cc:492] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d: No bootstrap required, opened a new log
I20260808 07:09:33.177505 26455 log.cc:824] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:33.177556 26453 ts_tablet_manager.cc:1397] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:09:33.177561 26456 log.cc:824] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:33.178174 26455 tablet_bootstrap.cc:492] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63: No bootstrap required, opened a new log
I20260808 07:09:33.178236 26455 ts_tablet_manager.cc:1397] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:09:33.178303 26456 tablet_bootstrap.cc:492] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f: No bootstrap required, opened a new log
I20260808 07:09:33.178375 26456 ts_tablet_manager.cc:1397] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:09:33.179497 26453 raft_consensus.cc:348] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbd04186ebec4e528e97f13a64258c63" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32923 } } peers { permanent_uuid: "85f64cb44e26461caf381690f4a4255f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38141 } } peers { permanent_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 44433 } }
I20260808 07:09:33.179688 26453 raft_consensus.cc:374] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:33.179728 26453 raft_consensus.cc:729] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3936f2e2a6f14ed3ade6486acfb2f36d, State: Initialized, Role: FOLLOWER
I20260808 07:09:33.179783 26455 raft_consensus.cc:348] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbd04186ebec4e528e97f13a64258c63" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32923 } } peers { permanent_uuid: "85f64cb44e26461caf381690f4a4255f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38141 } } peers { permanent_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 44433 } }
I20260808 07:09:33.179872 26453 consensus_queue.cc:260] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbd04186ebec4e528e97f13a64258c63" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32923 } } peers { permanent_uuid: "85f64cb44e26461caf381690f4a4255f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38141 } } peers { permanent_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 44433 } }
I20260808 07:09:33.179936 26455 raft_consensus.cc:374] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:33.179978 26455 raft_consensus.cc:729] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbd04186ebec4e528e97f13a64258c63, State: Initialized, Role: FOLLOWER
I20260808 07:09:33.180094 26455 consensus_queue.cc:260] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbd04186ebec4e528e97f13a64258c63" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32923 } } peers { permanent_uuid: "85f64cb44e26461caf381690f4a4255f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38141 } } peers { permanent_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 44433 } }
I20260808 07:09:33.180151 26453 ts_tablet_manager.cc:1428] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 07:09:33.180299 26033 heartbeater.cc:503] Master 127.29.82.126:35151 was elected leader, sending a full tablet report...
I20260808 07:09:33.180251 26456 raft_consensus.cc:348] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbd04186ebec4e528e97f13a64258c63" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32923 } } peers { permanent_uuid: "85f64cb44e26461caf381690f4a4255f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38141 } } peers { permanent_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 44433 } }
I20260808 07:09:33.180366 26455 ts_tablet_manager.cc:1428] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:09:33.180390 26456 raft_consensus.cc:374] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:33.180413 26456 raft_consensus.cc:729] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f64cb44e26461caf381690f4a4255f, State: Initialized, Role: FOLLOWER
I20260808 07:09:33.180498 26226 heartbeater.cc:503] Master 127.29.82.126:35151 was elected leader, sending a full tablet report...
I20260808 07:09:33.180503 26456 consensus_queue.cc:260] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbd04186ebec4e528e97f13a64258c63" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32923 } } peers { permanent_uuid: "85f64cb44e26461caf381690f4a4255f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38141 } } peers { permanent_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 44433 } }
I20260808 07:09:33.180759 26456 ts_tablet_manager.cc:1428] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:09:33.180876 26430 heartbeater.cc:503] Master 127.29.82.126:35151 was elected leader, sending a full tablet report...
W20260808 07:09:33.233695 26228 tablet.cc:2369] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:09:33.258586 26461 raft_consensus.cc:482] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:33.258811 26461 raft_consensus.cc:504] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbd04186ebec4e528e97f13a64258c63" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32923 } } peers { permanent_uuid: "85f64cb44e26461caf381690f4a4255f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38141 } } peers { permanent_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 44433 } }
I20260808 07:09:33.259271 26461 leader_election.cc:288] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbd04186ebec4e528e97f13a64258c63 (127.29.82.66:32923), 85f64cb44e26461caf381690f4a4255f (127.29.82.67:38141)
I20260808 07:09:33.262181 26447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.259584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:59153 (local address 127.29.82.66:32923)
0808 07:09:33.259641 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.259643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.259653 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:09:33.259682 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.259683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.259693 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.259749 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:33.259932 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.260458 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.261438 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.261831 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.261888 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.261897 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.262066 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.262106 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:09:33.262181 26449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.259673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:41333 (local address 127.29.82.67:38141)
0808 07:09:33.259716 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.259718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.259779 (+ 61us) server_negotiation.cc:407] Connection header received
0808 07:09:33.259816 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.259816 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.259829 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.259896 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:33.260039 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.260497 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.261486 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.261853 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.261923 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.261932 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.262072 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.262110 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:09:33.262198 26035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.259483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:32923 (local address 127.29.82.65:59153)
0808 07:09:33.259545 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:33.259559 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:33.259611 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:33.259781 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:33.259784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:33.259786 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:33.259864 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.259866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.260538 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.260539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.261359 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.261361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.261911 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.261912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.262000 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.262004 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:33.262050 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:09:33.262095 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":41}
I20260808 07:09:33.262203 26467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.259531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:38141 (local address 127.29.82.65:41333)
0808 07:09:33.259714 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:33.259722 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:33.259769 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:33.259902 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:33.259903 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:33.259904 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:33.259976 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.259978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.260583 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.260584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.261388 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.261390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.261939 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.261940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.262000 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.262004 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:33.262053 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:09:33.262096 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":3,"thread_start_us":118,"threads_started":1}
I20260808 07:09:33.262641 26164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e996319167624194b650d4c40cad139d" candidate_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbd04186ebec4e528e97f13a64258c63" is_pre_election: true
I20260808 07:09:33.262670 26368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e996319167624194b650d4c40cad139d" candidate_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f64cb44e26461caf381690f4a4255f" is_pre_election: true
I20260808 07:09:33.262800 26164 raft_consensus.cc:2454] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3936f2e2a6f14ed3ade6486acfb2f36d in term 0.
I20260808 07:09:33.262799 26368 raft_consensus.cc:2454] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3936f2e2a6f14ed3ade6486acfb2f36d in term 0.
I20260808 07:09:33.263049 25878 leader_election.cc:302] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3936f2e2a6f14ed3ade6486acfb2f36d, bbd04186ebec4e528e97f13a64258c63; no voters:
I20260808 07:09:33.263237 26461 raft_consensus.cc:2781] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:09:33.263289 26461 raft_consensus.cc:482] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:09:33.263310 26461 raft_consensus.cc:3037] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:33.264029 26461 raft_consensus.cc:504] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbd04186ebec4e528e97f13a64258c63" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32923 } } peers { permanent_uuid: "85f64cb44e26461caf381690f4a4255f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38141 } } peers { permanent_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 44433 } }
I20260808 07:09:33.264153 26461 leader_election.cc:288] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [CANDIDATE]: Term 1 election: Requested vote from peers bbd04186ebec4e528e97f13a64258c63 (127.29.82.66:32923), 85f64cb44e26461caf381690f4a4255f (127.29.82.67:38141)
I20260808 07:09:33.264333 26164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e996319167624194b650d4c40cad139d" candidate_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbd04186ebec4e528e97f13a64258c63"
I20260808 07:09:33.264379 26368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e996319167624194b650d4c40cad139d" candidate_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f64cb44e26461caf381690f4a4255f"
I20260808 07:09:33.264438 26164 raft_consensus.cc:3037] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:33.264470 26368 raft_consensus.cc:3037] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:33.265398 26164 raft_consensus.cc:2454] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3936f2e2a6f14ed3ade6486acfb2f36d in term 1.
I20260808 07:09:33.265398 26368 raft_consensus.cc:2454] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3936f2e2a6f14ed3ade6486acfb2f36d in term 1.
I20260808 07:09:33.265690 25875 leader_election.cc:302] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3936f2e2a6f14ed3ade6486acfb2f36d, 85f64cb44e26461caf381690f4a4255f, bbd04186ebec4e528e97f13a64258c63; no voters:
I20260808 07:09:33.265830 26461 raft_consensus.cc:2781] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:33.266018 26461 raft_consensus.cc:686] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [term 1 LEADER]: Becoming Leader. State: Replica: 3936f2e2a6f14ed3ade6486acfb2f36d, State: Running, Role: LEADER
I20260808 07:09:33.266114 26461 consensus_queue.cc:237] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbd04186ebec4e528e97f13a64258c63" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32923 } } peers { permanent_uuid: "85f64cb44e26461caf381690f4a4255f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38141 } } peers { permanent_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 44433 } }
I20260808 07:09:33.266924 25757 catalog_manager.cc:5495] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3936f2e2a6f14ed3ade6486acfb2f36d (127.29.82.65). New cstate: current_term: 1 leader_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbd04186ebec4e528e97f13a64258c63" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f64cb44e26461caf381690f4a4255f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3936f2e2a6f14ed3ade6486acfb2f36d" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 44433 } health_report { overall_health: HEALTHY } } }
I20260808 07:09:33.291074 26452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.288785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32866 (local address 127.29.82.65:44433)
0808 07:09:33.288861 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.288863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.288871 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:09:33.288911 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.288911 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.288933 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.289014 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:09:33.289134 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.289662 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.290370 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.290576 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.290632 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.290764 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:09:33.290873 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:09:33.290934 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.290950 (+ 16us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.290969 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 07:09:33.292925 26164 raft_consensus.cc:1261] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63 [term 1 FOLLOWER]: Refusing update from remote peer 3936f2e2a6f14ed3ade6486acfb2f36d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:33.292925 26368 raft_consensus.cc:1261] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f [term 1 FOLLOWER]: Refusing update from remote peer 3936f2e2a6f14ed3ade6486acfb2f36d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:33.293365 26468 consensus_queue.cc:1035] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f64cb44e26461caf381690f4a4255f" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:33.293498 26461 consensus_queue.cc:1035] T e996319167624194b650d4c40cad139d P 3936f2e2a6f14ed3ade6486acfb2f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbd04186ebec4e528e97f13a64258c63" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:33.296103 26474 mvcc.cc:205] Tried to move back new op lower bound from 7316164498604941312 to 7316164498498613248. Current Snapshot: MvccSnapshot[applied={T|T < 7316164498604941312}]
I20260808 07:09:33.296382 26473 mvcc.cc:205] Tried to move back new op lower bound from 7316164498604941312 to 7316164498498613248. Current Snapshot: MvccSnapshot[applied={T|T < 7316164498604941312}]
I20260808 07:09:33.298508 25757 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:33.298599 25757 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:33.299294 25757 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 35092274b6634172a4851b3eb1813fc7: Sending DeleteTablet for 3 replicas of tablet e996319167624194b650d4c40cad139d
I20260808 07:09:33.299603 26128 tablet_service.cc:1514] Processing DeleteTablet for tablet e996319167624194b650d4c40cad139d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:33 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:44988
I20260808 07:09:33.299693 26335 tablet_service.cc:1514] Processing DeleteTablet for tablet e996319167624194b650d4c40cad139d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:33 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:51592
I20260808 07:09:33.299824 26485 tablet_replica.cc:330] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63: stopping tablet replica
I20260808 07:09:33.299912 26485 raft_consensus.cc:2229] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:33.299932 26486 tablet_replica.cc:330] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f: stopping tablet replica
I20260808 07:09:33.300021 26485 raft_consensus.cc:2258] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:33.300020 26486 raft_consensus.cc:2229] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:33.300107 26486 raft_consensus.cc:2258] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:33.300128 25941 tablet_service.cc:1514] Processing DeleteTablet for tablet e996319167624194b650d4c40cad139d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:33 UTC) from {username='kudu', principal='kudu/127.29.82.126@KRBTEST.COM'} at 127.0.0.1:32860
I20260808 07:09:33.300501 26485 ts_tablet_manager.cc:1905] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:33.300601 26486 ts_tablet_manager.cc:1905] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:33.300622 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 25851
I20260808 07:09:33.303371 26486 ts_tablet_manager.cc:1918] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:33.303372 26485 ts_tablet_manager.cc:1918] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:33.303443 26486 log.cc:1196] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/e996319167624194b650d4c40cad139d
I20260808 07:09:33.303443 26485 log.cc:1196] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/e996319167624194b650d4c40cad139d
I20260808 07:09:33.303720 26485 ts_tablet_manager.cc:1939] T e996319167624194b650d4c40cad139d P bbd04186ebec4e528e97f13a64258c63: Deleting consensus metadata
I20260808 07:09:33.303720 26486 ts_tablet_manager.cc:1939] T e996319167624194b650d4c40cad139d P 85f64cb44e26461caf381690f4a4255f: Deleting consensus metadata
I20260808 07:09:33.304157 25743 catalog_manager.cc:4841] TS bbd04186ebec4e528e97f13a64258c63 (127.29.82.66:32923): tablet e996319167624194b650d4c40cad139d (table test-table [id=0d7ef9f482f543d2af01952717c8ec46]) successfully deleted
I20260808 07:09:33.308997 25741 catalog_manager.cc:4841] TS 85f64cb44e26461caf381690f4a4255f (127.29.82.67:38141): tablet e996319167624194b650d4c40cad139d (table test-table [id=0d7ef9f482f543d2af01952717c8ec46]) successfully deleted
W20260808 07:09:33.310818 25741 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:44433 (error 108)
I20260808 07:09:33.311406 26451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.311245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:44433 (local address 127.0.0.1:32880)
0808 07:09:33.311323 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:33.311373 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:44433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 07:09:33.311445 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 26042
W20260808 07:09:33.311561 25741 catalog_manager.cc:4584] TS 3936f2e2a6f14ed3ade6486acfb2f36d (127.29.82.65:44433): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e996319167624194b650d4c40cad139d: Network error: Client connection negotiation failed: client connection to 127.29.82.65:44433: connect: Connection refused (error 111)
I20260808 07:09:33.322413 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 26238
I20260808 07:09:33.336899 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 25714
2026-08-08T07:09:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2107 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T07:09:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:33Z Disabled control of system clock
I20260808 07:09:33.373790 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:35131
--webserver_interface=127.29.82.126
--webserver_port=0
--builtin_ntp_servers=127.29.82.84:36055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:35131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:09:33.456554 26493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:33.456773 26493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:33.456792 26493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:33.457978 26493 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:33.458021 26493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:33.458033 26493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:33.458045 26493 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:33.458055 26493 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:33.459412 26493 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:36055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:35131
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:35131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:33.459649 26493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:33.459947 26493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:33.464689 26498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:33.464696 26503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:33.464847 26493 server_base.cc:1034] running on GCE node
W20260808 07:09:33.464692 26499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:33.465246 26493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:33.465539 26493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:33.466674 26493 hybrid_clock.cc:648] HybridClock initialized: now 1786172973466655 us; error 37 us; skew 500 ppm
I20260808 07:09:33.467958 26493 webserver.cc:460] Webserver started at http://127.29.82.126:36973/ using document root <none> and password file <none>
I20260808 07:09:33.468217 26493 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:33.468266 26493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:33.468375 26493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:33.469489 26493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "bb2378bb751e41b49a064743190a576d"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "dfa0f134f95b3459f716399edbc57f88"
server_key_iv: "ed31bb22960a7f1b46e89d97ab525ccc"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.469816 26493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "bb2378bb751e41b49a064743190a576d"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "dfa0f134f95b3459f716399edbc57f88"
server_key_iv: "ed31bb22960a7f1b46e89d97ab525ccc"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.471148 26493 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:33.471861 26517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:33.472031 26493 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:33.472121 26493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "bb2378bb751e41b49a064743190a576d"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "dfa0f134f95b3459f716399edbc57f88"
server_key_iv: "ed31bb22960a7f1b46e89d97ab525ccc"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.472182 26493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:33.486588 26493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:33.486903 26493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:33.487042 26493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:33.491022 26493 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:35131
I20260808 07:09:33.491067 26601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:35131 every 8 connection(s)
I20260808 07:09:33.491413 26493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:33.492430 26602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:33.494850 26602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d: Bootstrap starting.
I20260808 07:09:33.495433 26602 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:33.495708 26602 log.cc:824] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:33.496421 26602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d: No bootstrap required, opened a new log
I20260808 07:09:33.498096 26602 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb2378bb751e41b49a064743190a576d" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35131 } }
I20260808 07:09:33.498235 26602 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:33.498286 26602 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb2378bb751e41b49a064743190a576d, State: Initialized, Role: FOLLOWER
I20260808 07:09:33.498432 26602 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb2378bb751e41b49a064743190a576d" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35131 } }
I20260808 07:09:33.498461 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 26493
I20260808 07:09:33.498502 26602 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:33.498525 26602 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:33.498569 26602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:33.498579 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:33.498759 30025 external_mini_cluster.cc:1428] Setting key f58adb1ed3711e73dd3c13b4f1ef55a2
I20260808 07:09:33.499105 26602 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb2378bb751e41b49a064743190a576d" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35131 } }
I20260808 07:09:33.499207 26602 leader_election.cc:302] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb2378bb751e41b49a064743190a576d; no voters:
I20260808 07:09:33.499382 26602 leader_election.cc:288] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:33.499449 26607 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:33.499579 26607 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [term 1 LEADER]: Becoming Leader. State: Replica: bb2378bb751e41b49a064743190a576d, State: Running, Role: LEADER
I20260808 07:09:33.499660 26607 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb2378bb751e41b49a064743190a576d" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35131 } }
I20260808 07:09:33.499681 26602 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:33.499989 26607 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb2378bb751e41b49a064743190a576d. Latest consensus state: current_term: 1 leader_uuid: "bb2378bb751e41b49a064743190a576d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb2378bb751e41b49a064743190a576d" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35131 } } }
I20260808 07:09:33.500059 26607 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:33.500221 26610 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb2378bb751e41b49a064743190a576d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb2378bb751e41b49a064743190a576d" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35131 } } }
I20260808 07:09:33.500312 26610 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d [sys.catalog]: This master's current role is: LEADER
W20260808 07:09:33.501438 26629 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:09:33.501495 26629 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:09:33.501540 26613 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:33.501791 26613 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:33.503362 26613 catalog_manager.cc:1347] Generated new cluster ID: a3a27b6925524f3dab9fe025abac1b9b
I20260808 07:09:33.503404 26613 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:33.504653 26608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.499256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42208 (local address 127.29.82.126:35131)
0808 07:09:33.499510 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.499520 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.499556 (+ 36us) server_negotiation.cc:407] Connection header received
0808 07:09:33.499682 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.499688 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.499761 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.499894 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:33.500389 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.501623 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.502411 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.502910 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.503051 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.503817 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:33.503821 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:33.503821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:33.504032 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:33.504071 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:33.504085 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:33.504137 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.504253 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.504448 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":92,"threads_started":1}
I20260808 07:09:33.515897 26613 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:33.516407 26613 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:33.523913 26613 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d: Generated new TSK 0
I20260808 07:09:33.524115 26613 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:33.526538 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.65:0
--local_ip_for_outbound_sockets=127.29.82.65
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:35131
--builtin_ntp_servers=127.29.82.84:36055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:09:33.646559 26633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:33.646872 26633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:33.646909 26633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:33.648564 26633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:33.648640 26633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:33.648676 26633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.65
I20260808 07:09:33.650677 26633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:36055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.82.65
--webserver_port=0
--tserver_master_addrs=127.29.82.126:35131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.65
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:33.650942 26633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:33.651309 26633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:33.656430 26647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:33.656446 26645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:33.656544 26641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:33.656906 26633 server_base.cc:1034] running on GCE node
I20260808 07:09:33.657126 26633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:33.657402 26633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:33.658557 26633 hybrid_clock.cc:648] HybridClock initialized: now 1786172973658542 us; error 31 us; skew 500 ppm
I20260808 07:09:33.659765 26633 webserver.cc:460] Webserver started at http://127.29.82.65:39241/ using document root <none> and password file <none>
I20260808 07:09:33.659986 26633 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:33.660045 26633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:33.660178 26633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:33.661314 26633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/data/instance:
uuid: "39ff4aaf26bc4a37b06ce8449b706297"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "43c96517de4000b4673a629e8e33fecc"
server_key_iv: "3022ce7af15cef5cf1d2cff36da30872"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.661684 26633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance:
uuid: "39ff4aaf26bc4a37b06ce8449b706297"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "43c96517de4000b4673a629e8e33fecc"
server_key_iv: "3022ce7af15cef5cf1d2cff36da30872"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.662977 26633 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:09:33.663707 26654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:33.663861 26633 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:33.663959 26633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/wal
uuid: "39ff4aaf26bc4a37b06ce8449b706297"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "43c96517de4000b4673a629e8e33fecc"
server_key_iv: "3022ce7af15cef5cf1d2cff36da30872"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.664037 26633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:33.692268 26633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:33.692615 26633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:33.692767 26633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:33.693028 26633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:33.693413 26633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:33.693457 26633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:33.693490 26633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:33.693506 26633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:33.698877 26633 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.65:39967
I20260808 07:09:33.698945 26818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.65:39967 every 8 connection(s)
I20260808 07:09:33.699260 26633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/data/info.pb
I20260808 07:09:33.703676 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 26633
I20260808 07:09:33.703804 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-0/wal/instance
I20260808 07:09:33.704006 30025 external_mini_cluster.cc:1428] Setting key 69e34f3df46a2a9e4d1048b4a419d4e6
I20260808 07:09:33.704406 26608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.699980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.65:32901 (local address 127.29.82.126:35131)
0808 07:09:33.700084 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.700086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.700279 (+ 193us) server_negotiation.cc:407] Connection header received
0808 07:09:33.700793 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.700795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.700806 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.700844 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:33.701578 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.702078 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.703026 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.703219 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.703271 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.704106 (+ 835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:33.704108 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:33.704108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:33.704116 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:33.704135 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:33.704139 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:33.704204 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.704300 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.704335 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 07:09:33.704638 26824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.699967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:35131 (local address 127.29.82.65:32901)
0808 07:09:33.700176 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:33.700211 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:33.700697 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:33.700919 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:33.700923 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:33.700931 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:33.701508 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.701514 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.702144 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.702145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.702946 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.702948 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.703285 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.703286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.703396 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.703942 (+ 546us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:09:33.703943 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:33.703973 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:09:33.703998 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:33.704216 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:33.704222 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:33.704226 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:09:33.704298 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 07:09:33.704401 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
I20260808 07:09:33.705098 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.66:0
--local_ip_for_outbound_sockets=127.29.82.66
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:35131
--builtin_ntp_servers=127.29.82.84:36055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 07:09:33.705266 26820 heartbeater.cc:347] Connected to a master server at 127.29.82.126:35131
I20260808 07:09:33.705355 26820 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:33.705540 26820 heartbeater.cc:511] Master 127.29.82.126:35131 requested a full tablet report, sending...
I20260808 07:09:33.706036 26552 ts_manager.cc:194] Registered new tserver with Master: 39ff4aaf26bc4a37b06ce8449b706297 (127.29.82.65:39967)
I20260808 07:09:33.706669 26552 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.82.65:32901
W20260808 07:09:33.788116 26825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:33.788340 26825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:33.788360 26825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:33.789492 26825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:33.789530 26825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:33.789554 26825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.66
I20260808 07:09:33.790853 26825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:36055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.82.66
--webserver_port=0
--tserver_master_addrs=127.29.82.126:35131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.66
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:33.791049 26825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:33.791316 26825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:33.796074 26834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:33.796157 26835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:33.796066 26838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:33.796272 26825 server_base.cc:1034] running on GCE node
I20260808 07:09:33.796491 26825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:33.796710 26825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:33.797851 26825 hybrid_clock.cc:648] HybridClock initialized: now 1786172973797833 us; error 30 us; skew 500 ppm
I20260808 07:09:33.799026 26825 webserver.cc:460] Webserver started at http://127.29.82.66:35935/ using document root <none> and password file <none>
I20260808 07:09:33.799268 26825 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:33.799321 26825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:33.799449 26825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:33.800560 26825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/data/instance:
uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "0c75a950768828f835e516b0cd044e66"
server_key_iv: "1525343e55a2aa2fb06eafa832e5e883"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.800889 26825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance:
uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "0c75a950768828f835e516b0cd044e66"
server_key_iv: "1525343e55a2aa2fb06eafa832e5e883"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.802181 26825 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:09:33.802850 26847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:33.802994 26825 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:09:33.803081 26825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/wal
uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "0c75a950768828f835e516b0cd044e66"
server_key_iv: "1525343e55a2aa2fb06eafa832e5e883"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.803144 26825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:33.824178 26825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:33.824529 26825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:33.824671 26825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:33.824903 26825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:33.825266 26825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:33.825302 26825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:33.825335 26825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:33.825352 26825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:33.830749 26825 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.66:35019
I20260808 07:09:33.830809 27023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.66:35019 every 8 connection(s)
I20260808 07:09:33.831141 26825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/data/info.pb
I20260808 07:09:33.836464 26608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.831905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.66:59017 (local address 127.29.82.126:35131)
0808 07:09:33.831990 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.831992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.832170 (+ 178us) server_negotiation.cc:407] Connection header received
0808 07:09:33.832659 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.832664 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.832679 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.832745 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:33.833572 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.834106 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.835117 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.835297 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.835340 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.836189 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:33.836190 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:33.836190 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:33.836195 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:33.836209 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:33.836213 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:33.836252 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.836377 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.836401 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 07:09:33.836715 27026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.831851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:35131 (local address 127.29.82.66:59017)
0808 07:09:33.832039 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:33.832081 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:33.832561 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:33.832862 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:33.832866 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:33.832876 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:33.833456 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.833461 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.834191 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.834192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.835043 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.835046 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.835381 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.835382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.835551 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.836059 (+ 508us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:09:33.836060 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:33.836090 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:09:33.836113 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:33.836290 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:33.836299 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:33.836302 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:09:33.836378 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 07:09:33.836480 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":72,"threads_started":1}
I20260808 07:09:33.837205 27024 heartbeater.cc:347] Connected to a master server at 127.29.82.126:35131
I20260808 07:09:33.837312 27024 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:33.837495 27024 heartbeater.cc:511] Master 127.29.82.126:35131 requested a full tablet report, sending...
I20260808 07:09:33.837872 26552 ts_manager.cc:194] Registered new tserver with Master: c2a56f9f33bf47f6b5d96928d8d81ad2 (127.29.82.66:35019)
I20260808 07:09:33.838248 26552 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.82.66:59017
I20260808 07:09:33.840997 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 26825
I20260808 07:09:33.841106 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/wal/instance
I20260808 07:09:33.841341 30025 external_mini_cluster.cc:1428] Setting key 265f837a5ca202d21fcf3c9ae72e644c
I20260808 07:09:33.842219 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.82.67:0
--local_ip_for_outbound_sockets=127.29.82.67
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:35131
--builtin_ntp_servers=127.29.82.84:36055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:09:33.925190 27027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:33.925419 27027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:33.925441 27027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:33.926752 27027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:33.926820 27027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:33.926847 27027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.82.67
I20260808 07:09:33.928318 27027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:36055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.82.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.82.67
--webserver_port=0
--tserver_master_addrs=127.29.82.126:35131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.82.67
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:33.928570 27027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:33.928872 27027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:33.933869 27034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:33.933881 27037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:33.933887 27033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:33.934150 27027 server_base.cc:1034] running on GCE node
I20260808 07:09:33.934357 27027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:33.934592 27027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:33.935763 27027 hybrid_clock.cc:648] HybridClock initialized: now 1786172973935744 us; error 30 us; skew 500 ppm
I20260808 07:09:33.937115 27027 webserver.cc:460] Webserver started at http://127.29.82.67:37105/ using document root <none> and password file <none>
I20260808 07:09:33.937364 27027 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:33.937417 27027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:33.937553 27027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:33.938711 27027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/data/instance:
uuid: "7614cb4396794233b28de714d9fa2512"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "23a4143f8523d47f6f068b586530f6d4"
server_key_iv: "3f212d375be2e84b2262f95c55857499"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.939056 27027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance:
uuid: "7614cb4396794233b28de714d9fa2512"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "23a4143f8523d47f6f068b586530f6d4"
server_key_iv: "3f212d375be2e84b2262f95c55857499"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.940290 27027 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:09:33.940984 27044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:33.941187 27027 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:09:33.941279 27027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/wal
uuid: "7614cb4396794233b28de714d9fa2512"
format_stamp: "Formatted at 2026-08-08 07:09:33 on dist-test-slave-rmhg"
server_key: "23a4143f8523d47f6f068b586530f6d4"
server_key_iv: "3f212d375be2e84b2262f95c55857499"
server_key_version: "encryptionkey@0"
I20260808 07:09:33.941345 27027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:33.957530 27027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:33.957865 27027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:33.958012 27027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:33.958249 27027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:09:33.958586 27027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:09:33.958623 27027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:33.958652 27027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:09:33.958669 27027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:33.964180 27027 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.67:38561
I20260808 07:09:33.964257 27209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.67:38561 every 8 connection(s)
I20260808 07:09:33.964599 27027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/data/info.pb
I20260808 07:09:33.968058 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 27027
I20260808 07:09:33.968190 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/wal/instance
I20260808 07:09:33.968406 30025 external_mini_cluster.cc:1428] Setting key 098e3e15af09fe55452ca1724f1adcfe
I20260808 07:09:33.970361 26608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.965389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:37871 (local address 127.29.82.126:35131)
0808 07:09:33.965458 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.965461 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.965700 (+ 239us) server_negotiation.cc:407] Connection header received
0808 07:09:33.966229 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.966230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.966244 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.966304 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:33.967003 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.967579 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.968890 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.969212 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.969282 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.970135 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:33.970136 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:33.970136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:33.970140 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:33.970154 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:33.970158 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:33.970200 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.970274 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.970301 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 07:09:33.970597 27212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.965388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:35131 (local address 127.29.82.67:37871)
0808 07:09:33.965579 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:33.965615 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:33.966125 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:33.966381 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:33.966385 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:33.966394 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:09:33.966907 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.966912 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.967673 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.967674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.968799 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.968802 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.969293 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.969295 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.969466 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.969992 (+ 526us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:09:33.969993 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:09:33.970023 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:09:33.970047 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:09:33.970222 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:09:33.970226 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:09:33.970229 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:09:33.970278 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:09:33.970369 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":87,"threads_started":1}
I20260808 07:09:33.971037 27210 heartbeater.cc:347] Connected to a master server at 127.29.82.126:35131
I20260808 07:09:33.971125 27210 heartbeater.cc:464] Registering TS with master...
I20260808 07:09:33.971307 27210 heartbeater.cc:511] Master 127.29.82.126:35131 requested a full tablet report, sending...
I20260808 07:09:33.971644 26552 ts_manager.cc:194] Registered new tserver with Master: 7614cb4396794233b28de714d9fa2512 (127.29.82.67:38561)
I20260808 07:09:33.971998 26552 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.82.67:37871
I20260808 07:09:33.980201 30025 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:09:33.984205 26608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.981631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42212 (local address 127.29.82.126:35131)
0808 07:09:33.981699 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.981701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.981778 (+ 77us) server_negotiation.cc:407] Connection header received
0808 07:09:33.981833 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.981834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.981845 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.981893 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:33.982018 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.982501 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.983265 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.983438 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.983480 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.984025 (+ 545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:33.984026 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:33.984027 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:33.984031 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:33.984044 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:33.984047 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:33.984084 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.984120 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.984144 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:09:33.985865 26552 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42212:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:09:33.987402 26552 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:09:33.993738 27226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.989871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39134 (local address 127.29.82.65:39967)
0808 07:09:33.990049 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.990053 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.990061 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:09:33.990095 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.990097 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.990112 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.990308 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:33.990363 (+ 55us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.991456 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.992638 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.993368 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.993445 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.993547 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.993636 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.993669 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":87,"threads_started":1}
I20260808 07:09:33.993752 27220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.989508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:39967 (local address 127.0.0.1:39134)
0808 07:09:33.989753 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:33.989761 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:33.989800 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:33.990209 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:33.990210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:33.990212 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:33.990242 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.990243 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.991531 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.991532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.992563 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.992565 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.993449 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.993450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.993536 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.993555 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 07:09:33.993622 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 07:09:33.993678 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":100,"threads_started":1}
I20260808 07:09:33.994155 27222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.989505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.67:38561 (local address 127.0.0.1:40112)
0808 07:09:33.989678 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:33.989717 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:33.989786 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:33.990321 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:33.990322 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:33.990324 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:33.990373 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.990375 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.991258 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.991260 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.992498 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.992501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.993932 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.993933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.993994 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.993997 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:09:33.994050 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 07:09:33.994089 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":7,"thread_start_us":63,"threads_started":1}
I20260808 07:09:33.994277 27224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.989686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40112 (local address 127.29.82.67:38561)
0808 07:09:33.990098 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.990102 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.990112 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:09:33.990207 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.990209 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.990225 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.990446 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:33.990499 (+ 53us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.991180 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.992596 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.993368 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.993481 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.993555 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.994080 (+ 525us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.994125 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":92,"threads_started":1}
I20260808 07:09:33.994566 26724 tablet_service.cc:1467] Processing CreateTablet for tablet 43849c020adc463f9bbc78bbd5e19cf8 (DEFAULT_TABLE table=test-table [id=f2414935c96c4ccfb5c3586e3b2ff6c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:33.994863 27223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.989510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:35019 (local address 127.0.0.1:45102)
0808 07:09:33.989885 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:33.989893 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:33.989937 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:33.990128 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:33.990132 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:33.990135 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:33.990208 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.990209 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.992660 (+ 2451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.992661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.993468 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:33.993470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.994622 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.994623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:33.994679 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.994684 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:09:33.994751 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 07:09:33.994789 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":70,"threads_started":1}
I20260808 07:09:33.994886 27225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:33.989773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45102 (local address 127.29.82.66:35019)
0808 07:09:33.989949 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:33.989954 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:33.989965 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:09:33.990005 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:33.990007 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:33.990022 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:33.990115 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:33.990293 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.991443 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.993562 (+ 2119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:33.994446 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:33.994507 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:33.994590 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:33.994770 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 07:09:33.994808 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":73,"threads_started":1}
I20260808 07:09:33.995002 26724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43849c020adc463f9bbc78bbd5e19cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:33.995568 26919 tablet_service.cc:1467] Processing CreateTablet for tablet 43849c020adc463f9bbc78bbd5e19cf8 (DEFAULT_TABLE table=test-table [id=f2414935c96c4ccfb5c3586e3b2ff6c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:33.995780 27118 tablet_service.cc:1467] Processing CreateTablet for tablet 43849c020adc463f9bbc78bbd5e19cf8 (DEFAULT_TABLE table=test-table [id=f2414935c96c4ccfb5c3586e3b2ff6c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:09:33.995925 26919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43849c020adc463f9bbc78bbd5e19cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:33.996044 27118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43849c020adc463f9bbc78bbd5e19cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:33.998487 27227 tablet_bootstrap.cc:492] T 43849c020adc463f9bbc78bbd5e19cf8 P 39ff4aaf26bc4a37b06ce8449b706297: Bootstrap starting.
I20260808 07:09:33.998723 27229 tablet_bootstrap.cc:492] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512: Bootstrap starting.
I20260808 07:09:33.999056 27231 tablet_bootstrap.cc:492] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2: Bootstrap starting.
I20260808 07:09:33.999337 27229 tablet_bootstrap.cc:654] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:33.999614 27229 log.cc:824] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:33.999765 27231 tablet_bootstrap.cc:654] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:34.000084 27231 log.cc:824] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:34.000391 27227 tablet_bootstrap.cc:654] T 43849c020adc463f9bbc78bbd5e19cf8 P 39ff4aaf26bc4a37b06ce8449b706297: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:34.000597 27229 tablet_bootstrap.cc:492] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512: No bootstrap required, opened a new log
I20260808 07:09:34.000669 27229 ts_tablet_manager.cc:1397] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:09:34.000705 27227 log.cc:824] T 43849c020adc463f9bbc78bbd5e19cf8 P 39ff4aaf26bc4a37b06ce8449b706297: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:34.000836 27231 tablet_bootstrap.cc:492] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2: No bootstrap required, opened a new log
I20260808 07:09:34.000902 27231 ts_tablet_manager.cc:1397] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:09:34.001586 27227 tablet_bootstrap.cc:492] T 43849c020adc463f9bbc78bbd5e19cf8 P 39ff4aaf26bc4a37b06ce8449b706297: No bootstrap required, opened a new log
I20260808 07:09:34.001662 27227 ts_tablet_manager.cc:1397] T 43849c020adc463f9bbc78bbd5e19cf8 P 39ff4aaf26bc4a37b06ce8449b706297: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:09:34.002903 27231 raft_consensus.cc:348] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7614cb4396794233b28de714d9fa2512" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38561 } } peers { permanent_uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 35019 } } peers { permanent_uuid: "39ff4aaf26bc4a37b06ce8449b706297" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39967 } }
I20260808 07:09:34.003050 27231 raft_consensus.cc:374] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:34.003082 27231 raft_consensus.cc:729] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2a56f9f33bf47f6b5d96928d8d81ad2, State: Initialized, Role: FOLLOWER
I20260808 07:09:34.003221 27231 consensus_queue.cc:260] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7614cb4396794233b28de714d9fa2512" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38561 } } peers { permanent_uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 35019 } } peers { permanent_uuid: "39ff4aaf26bc4a37b06ce8449b706297" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39967 } }
I20260808 07:09:34.003350 27229 raft_consensus.cc:348] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7614cb4396794233b28de714d9fa2512" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38561 } } peers { permanent_uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 35019 } } peers { permanent_uuid: "39ff4aaf26bc4a37b06ce8449b706297" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39967 } }
I20260808 07:09:34.003507 27024 heartbeater.cc:503] Master 127.29.82.126:35131 was elected leader, sending a full tablet report...
I20260808 07:09:34.003511 27229 raft_consensus.cc:374] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:34.003553 27229 raft_consensus.cc:729] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7614cb4396794233b28de714d9fa2512, State: Initialized, Role: FOLLOWER
I20260808 07:09:34.003669 27229 consensus_queue.cc:260] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7614cb4396794233b28de714d9fa2512" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38561 } } peers { permanent_uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 35019 } } peers { permanent_uuid: "39ff4aaf26bc4a37b06ce8449b706297" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39967 } }
I20260808 07:09:34.003758 27231 ts_tablet_manager.cc:1428] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:09:34.003901 27229 ts_tablet_manager.cc:1428] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:09:34.004024 27210 heartbeater.cc:503] Master 127.29.82.126:35131 was elected leader, sending a full tablet report...
I20260808 07:09:34.004035 27227 raft_consensus.cc:348] T 43849c020adc463f9bbc78bbd5e19cf8 P 39ff4aaf26bc4a37b06ce8449b706297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7614cb4396794233b28de714d9fa2512" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38561 } } peers { permanent_uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 35019 } } peers { permanent_uuid: "39ff4aaf26bc4a37b06ce8449b706297" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39967 } }
I20260808 07:09:34.004180 27227 raft_consensus.cc:374] T 43849c020adc463f9bbc78bbd5e19cf8 P 39ff4aaf26bc4a37b06ce8449b706297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:34.004223 27227 raft_consensus.cc:729] T 43849c020adc463f9bbc78bbd5e19cf8 P 39ff4aaf26bc4a37b06ce8449b706297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39ff4aaf26bc4a37b06ce8449b706297, State: Initialized, Role: FOLLOWER
I20260808 07:09:34.004333 27227 consensus_queue.cc:260] T 43849c020adc463f9bbc78bbd5e19cf8 P 39ff4aaf26bc4a37b06ce8449b706297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7614cb4396794233b28de714d9fa2512" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38561 } } peers { permanent_uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 35019 } } peers { permanent_uuid: "39ff4aaf26bc4a37b06ce8449b706297" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39967 } }
I20260808 07:09:34.004596 27227 ts_tablet_manager.cc:1428] T 43849c020adc463f9bbc78bbd5e19cf8 P 39ff4aaf26bc4a37b06ce8449b706297: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:09:34.004737 26820 heartbeater.cc:503] Master 127.29.82.126:35131 was elected leader, sending a full tablet report...
I20260808 07:09:34.031000 27239 raft_consensus.cc:482] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:09:34.031136 27239 raft_consensus.cc:504] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7614cb4396794233b28de714d9fa2512" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38561 } } peers { permanent_uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 35019 } } peers { permanent_uuid: "39ff4aaf26bc4a37b06ce8449b706297" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39967 } }
I20260808 07:09:34.031523 27239 leader_election.cc:288] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2a56f9f33bf47f6b5d96928d8d81ad2 (127.29.82.66:35019), 39ff4aaf26bc4a37b06ce8449b706297 (127.29.82.65:39967)
I20260808 07:09:34.035307 27226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:34.031784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:44223 (local address 127.29.82.65:39967)
0808 07:09:34.031827 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:34.031829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:34.031939 (+ 110us) server_negotiation.cc:407] Connection header received
0808 07:09:34.031970 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:34.031971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:34.031982 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:34.032032 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:34.032165 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:34.032863 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:34.034364 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:34.034927 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:34.035007 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:34.035016 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:34.035193 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 07:09:34.035232 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:09:34.035307 27225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:34.031745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.82.67:33583 (local address 127.29.82.66:35019)
0808 07:09:34.031787 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:34.031789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:34.031797 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:09:34.031876 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:34.031877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:34.031888 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:34.031945 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:09:34.032111 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:34.032863 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:34.034363 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:34.034926 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:34.035013 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:34.035020 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:34.035193 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 07:09:34.035233 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:09:34.035346 27212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:34.031679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.66:35019 (local address 127.29.82.67:33583)
0808 07:09:34.031738 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:34.031749 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:34.031791 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:34.031962 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:34.031963 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:34.031965 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:34.032042 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:34.032044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:34.032944 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:34.032945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:34.034268 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:34.034272 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:34.035015 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:34.035016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:34.035121 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:34.035127 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:09:34.035179 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 07:09:34.035230 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":18}
I20260808 07:09:34.035530 27242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:34.031697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:39967 (local address 127.29.82.67:44223)
0808 07:09:34.031873 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:34.031882 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:09:34.031929 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:09:34.032045 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:09:34.032045 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:09:34.032047 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:09:34.032103 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:34.032104 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:34.032944 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:34.032944 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:34.034269 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:09:34.034272 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:09:34.035016 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:09:34.035016 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:09:34.035120 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:34.035127 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 07:09:34.035179 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 07:09:34.035226 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":87,"thread_start_us":95,"threads_started":1}
I20260808 07:09:34.035704 26954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43849c020adc463f9bbc78bbd5e19cf8" candidate_uuid: "7614cb4396794233b28de714d9fa2512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2" is_pre_election: true
I20260808 07:09:34.035845 26954 raft_consensus.cc:2454] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7614cb4396794233b28de714d9fa2512 in term 0.
I20260808 07:09:34.036125 27049 leader_election.cc:302] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7614cb4396794233b28de714d9fa2512, c2a56f9f33bf47f6b5d96928d8d81ad2; no voters:
I20260808 07:09:34.036139 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43849c020adc463f9bbc78bbd5e19cf8" candidate_uuid: "7614cb4396794233b28de714d9fa2512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39ff4aaf26bc4a37b06ce8449b706297" is_pre_election: true
I20260808 07:09:34.036252 27239 raft_consensus.cc:2781] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:09:34.036310 27239 raft_consensus.cc:482] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:09:34.036298 26757 raft_consensus.cc:2454] T 43849c020adc463f9bbc78bbd5e19cf8 P 39ff4aaf26bc4a37b06ce8449b706297 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7614cb4396794233b28de714d9fa2512 in term 0.
I20260808 07:09:34.036338 27239 raft_consensus.cc:3037] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:34.037227 27239 raft_consensus.cc:504] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7614cb4396794233b28de714d9fa2512" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38561 } } peers { permanent_uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 35019 } } peers { permanent_uuid: "39ff4aaf26bc4a37b06ce8449b706297" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39967 } }
I20260808 07:09:34.037354 27239 leader_election.cc:288] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [CANDIDATE]: Term 1 election: Requested vote from peers c2a56f9f33bf47f6b5d96928d8d81ad2 (127.29.82.66:35019), 39ff4aaf26bc4a37b06ce8449b706297 (127.29.82.65:39967)
I20260808 07:09:34.037501 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43849c020adc463f9bbc78bbd5e19cf8" candidate_uuid: "7614cb4396794233b28de714d9fa2512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39ff4aaf26bc4a37b06ce8449b706297"
I20260808 07:09:34.037501 26954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43849c020adc463f9bbc78bbd5e19cf8" candidate_uuid: "7614cb4396794233b28de714d9fa2512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2"
I20260808 07:09:34.037569 26954 raft_consensus.cc:3037] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:34.037571 26757 raft_consensus.cc:3037] T 43849c020adc463f9bbc78bbd5e19cf8 P 39ff4aaf26bc4a37b06ce8449b706297 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:34.038272 26954 raft_consensus.cc:2454] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7614cb4396794233b28de714d9fa2512 in term 1.
I20260808 07:09:34.038326 26757 raft_consensus.cc:2454] T 43849c020adc463f9bbc78bbd5e19cf8 P 39ff4aaf26bc4a37b06ce8449b706297 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7614cb4396794233b28de714d9fa2512 in term 1.
I20260808 07:09:34.038460 27049 leader_election.cc:302] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7614cb4396794233b28de714d9fa2512, c2a56f9f33bf47f6b5d96928d8d81ad2; no voters:
I20260808 07:09:34.038573 27239 raft_consensus.cc:2781] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:34.038743 27239 raft_consensus.cc:686] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [term 1 LEADER]: Becoming Leader. State: Replica: 7614cb4396794233b28de714d9fa2512, State: Running, Role: LEADER
I20260808 07:09:34.038834 27239 consensus_queue.cc:237] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7614cb4396794233b28de714d9fa2512" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38561 } } peers { permanent_uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 35019 } } peers { permanent_uuid: "39ff4aaf26bc4a37b06ce8449b706297" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39967 } }
I20260808 07:09:34.039654 26551 catalog_manager.cc:5495] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7614cb4396794233b28de714d9fa2512 (127.29.82.67). New cstate: current_term: 1 leader_uuid: "7614cb4396794233b28de714d9fa2512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7614cb4396794233b28de714d9fa2512" member_type: VOTER last_known_addr { host: "127.29.82.67" port: 38561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39ff4aaf26bc4a37b06ce8449b706297" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39967 } health_report { overall_health: UNKNOWN } } }
I20260808 07:09:34.052568 27224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:34.050517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40122 (local address 127.29.82.67:38561)
0808 07:09:34.050560 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:34.050562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:34.050571 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:09:34.050626 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:34.050627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:34.050645 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:34.050703 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:09:34.050802 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:34.051269 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:34.051958 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:34.052157 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:34.052215 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:34.052309 (+ 94us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:09:34.052406 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:09:34.052461 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:34.052475 (+ 14us) server_negotiation.cc:299] Negotiation successful
0808 07:09:34.052494 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:09:34.054307 26954 raft_consensus.cc:1261] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2 [term 1 FOLLOWER]: Refusing update from remote peer 7614cb4396794233b28de714d9fa2512: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:34.054311 26757 raft_consensus.cc:1261] T 43849c020adc463f9bbc78bbd5e19cf8 P 39ff4aaf26bc4a37b06ce8449b706297 [term 1 FOLLOWER]: Refusing update from remote peer 7614cb4396794233b28de714d9fa2512: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:09:34.054659 27239 consensus_queue.cc:1035] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2a56f9f33bf47f6b5d96928d8d81ad2" member_type: VOTER last_known_addr { host: "127.29.82.66" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:34.054802 27243 consensus_queue.cc:1035] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39ff4aaf26bc4a37b06ce8449b706297" member_type: VOTER last_known_addr { host: "127.29.82.65" port: 39967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:09:34.059221 27255 mvcc.cc:205] Tried to move back new op lower bound from 7316164501724160000 to 7316164501663797248. Current Snapshot: MvccSnapshot[applied={T|T < 7316164501724160000 or (T in {7316164501724160000})}]
I20260808 07:09:34.059250 26551 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:34.059334 26551 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:09:34.059345 27253 mvcc.cc:205] Tried to move back new op lower bound from 7316164501724160000 to 7316164501663797248. Current Snapshot: MvccSnapshot[applied={T|T < 7316164501724160000 or (T in {7316164501724160000})}]
I20260808 07:09:34.060025 26551 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bb2378bb751e41b49a064743190a576d: Sending DeleteTablet for 3 replicas of tablet 43849c020adc463f9bbc78bbd5e19cf8
I20260808 07:09:34.060350 26919 tablet_service.cc:1514] Processing DeleteTablet for tablet 43849c020adc463f9bbc78bbd5e19cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:34 UTC) from {username='slave'} at 127.0.0.1:45102
I20260808 07:09:34.060403 26724 tablet_service.cc:1514] Processing DeleteTablet for tablet 43849c020adc463f9bbc78bbd5e19cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:34 UTC) from {username='slave'} at 127.0.0.1:39134
I20260808 07:09:34.060640 27118 tablet_service.cc:1514] Processing DeleteTablet for tablet 43849c020adc463f9bbc78bbd5e19cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:09:34 UTC) from {username='slave'} at 127.0.0.1:40112
I20260808 07:09:34.060858 27267 tablet_replica.cc:330] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512: stopping tablet replica
I20260808 07:09:34.060871 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 26633
I20260808 07:09:34.060995 27267 raft_consensus.cc:2229] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:09:34.061137 27267 raft_consensus.cc:2258] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:34.061609 27267 ts_tablet_manager.cc:1905] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:34.063328 27267 ts_tablet_manager.cc:1918] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:34.063458 27267 log.cc:1196] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-2/wal/wals/43849c020adc463f9bbc78bbd5e19cf8
I20260808 07:09:34.063793 27267 ts_tablet_manager.cc:1939] T 43849c020adc463f9bbc78bbd5e19cf8 P 7614cb4396794233b28de714d9fa2512: Deleting consensus metadata
I20260808 07:09:34.071218 27265 tablet_replica.cc:330] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2: stopping tablet replica
I20260808 07:09:34.071216 26526 catalog_manager.cc:4841] TS 7614cb4396794233b28de714d9fa2512 (127.29.82.67:38561): tablet 43849c020adc463f9bbc78bbd5e19cf8 (table test-table [id=f2414935c96c4ccfb5c3586e3b2ff6c0]) successfully deleted
I20260808 07:09:34.071383 27265 raft_consensus.cc:2229] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:09:34.071516 27265 raft_consensus.cc:2258] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:09:34.072515 27265 ts_tablet_manager.cc:1905] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:09:34.074090 27265 ts_tablet_manager.cc:1918] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:09:34.074167 27265 log.cc:1196] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2: Deleting WAL directory at /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172701750152-30025-0/minicluster-data/ts-1/wal/wals/43849c020adc463f9bbc78bbd5e19cf8
I20260808 07:09:34.074465 27265 ts_tablet_manager.cc:1939] T 43849c020adc463f9bbc78bbd5e19cf8 P c2a56f9f33bf47f6b5d96928d8d81ad2: Deleting consensus metadata
I20260808 07:09:34.074925 26527 catalog_manager.cc:4841] TS c2a56f9f33bf47f6b5d96928d8d81ad2 (127.29.82.66:35019): tablet 43849c020adc463f9bbc78bbd5e19cf8 (table test-table [id=f2414935c96c4ccfb5c3586e3b2ff6c0]) successfully deleted
W20260808 07:09:34.077091 26524 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.82.65:39967 (error 108)
I20260808 07:09:34.077653 27223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:34.077517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.65:39967 (local address 127.0.0.1:39136)
0808 07:09:34.077572 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:09:34.077615 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.65:39967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 07:09:34.077694 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 26825
W20260808 07:09:34.095960 26524 catalog_manager.cc:4584] TS 39ff4aaf26bc4a37b06ce8449b706297 (127.29.82.65:39967): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 43849c020adc463f9bbc78bbd5e19cf8: Network error: Client connection negotiation failed: client connection to 127.29.82.65:39967: connect: Connection refused (error 111)
I20260808 07:09:34.101161 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 27027
I20260808 07:09:34.109252 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 26493
2026-08-08T07:09:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (773 ms)
[----------] 6 tests from EncryptionPolicyTest (8896 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:34 dist-test-slave-rmhg krb5kdc[27274](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:34 dist-test-slave-rmhg krb5kdc[27274](info): set up 2 sockets
Aug 08 07:09:34 dist-test-slave-rmhg krb5kdc[27274](info): commencing operation
krb5kdc: starting...
W20260808 07:09:35.238883 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:35 dist-test-slave-rmhg krb5kdc[27274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:09:35.363832 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44233
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44233
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:35.447372 27302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:35.447607 27302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:35.447631 27302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:35.448793 27302 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:35.448843 27302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:35.448858 27302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:35.448869 27302 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:35.448880 27302 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:35.450555 27302 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44233
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:35.450781 27302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:35.450973 27302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:35.455956 27307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:35.455957 27308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:35.456221 27302 server_base.cc:1034] running on GCE node
W20260808 07:09:35.455956 27310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:35.456502 27302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:35.456776 27302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:35.457917 27302 hybrid_clock.cc:648] HybridClock initialized: now 1786172975457900 us; error 30 us; skew 500 ppm
Aug 08 07:09:35 dist-test-slave-rmhg krb5kdc[27274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172975, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:35.460476 27302 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:09:35.460950 27302 webserver.cc:460] Webserver started at http://127.0.0.1:36733/ using document root <none> and password file <none>
I20260808 07:09:35.461185 27302 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:35.461239 27302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:35.461380 27302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:35.462455 27302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "a1d6581e033c4aec82cb699d8588a614"
format_stamp: "Formatted at 2026-08-08 07:09:35 on dist-test-slave-rmhg"
server_key: "b2b4da4b36b1ba1b744ee84cda4e9edd"
server_key_iv: "c24cb25da73d9b63c9f2eee1e883d614"
server_key_version: "encryptionkey@0"
I20260808 07:09:35.462803 27302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "a1d6581e033c4aec82cb699d8588a614"
format_stamp: "Formatted at 2026-08-08 07:09:35 on dist-test-slave-rmhg"
server_key: "b2b4da4b36b1ba1b744ee84cda4e9edd"
server_key_iv: "c24cb25da73d9b63c9f2eee1e883d614"
server_key_version: "encryptionkey@0"
I20260808 07:09:35.464221 27302 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:35.464989 27321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:35.465178 27302 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:35.465271 27302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "a1d6581e033c4aec82cb699d8588a614"
format_stamp: "Formatted at 2026-08-08 07:09:35 on dist-test-slave-rmhg"
server_key: "b2b4da4b36b1ba1b744ee84cda4e9edd"
server_key_iv: "c24cb25da73d9b63c9f2eee1e883d614"
server_key_version: "encryptionkey@0"
I20260808 07:09:35.465328 27302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:35.478076 27302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:35.480225 27302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:35.480336 27302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:35.484130 27302 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44233
I20260808 07:09:35.484185 27394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44233 every 8 connection(s)
I20260808 07:09:35.484539 27302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:35.485486 27395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:35.487814 27395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614: Bootstrap starting.
I20260808 07:09:35.488407 27395 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:35.488674 27395 log.cc:824] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:35.489413 27395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614: No bootstrap required, opened a new log
I20260808 07:09:35.489712 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 27302
I20260808 07:09:35.489827 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:35.490023 30025 external_mini_cluster.cc:1428] Setting key 989ef0611c9b90315e64c266f064b4f7
I20260808 07:09:35.491483 27395 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1d6581e033c4aec82cb699d8588a614" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } }
I20260808 07:09:35.491627 27395 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:35.491649 27395 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1d6581e033c4aec82cb699d8588a614, State: Initialized, Role: FOLLOWER
I20260808 07:09:35.491760 27395 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1d6581e033c4aec82cb699d8588a614" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } }
I20260808 07:09:35.491829 27395 raft_consensus.cc:388] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:35.491852 27395 raft_consensus.cc:482] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:35.491904 27395 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:35.492478 27395 raft_consensus.cc:504] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1d6581e033c4aec82cb699d8588a614" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } }
I20260808 07:09:35.492583 27395 leader_election.cc:302] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1d6581e033c4aec82cb699d8588a614; no voters:
I20260808 07:09:35.492748 27395 leader_election.cc:288] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:35.492794 27403 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:35.492926 27403 raft_consensus.cc:686] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [term 1 LEADER]: Becoming Leader. State: Replica: a1d6581e033c4aec82cb699d8588a614, State: Running, Role: LEADER
I20260808 07:09:35.493018 27395 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:35.493011 27403 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1d6581e033c4aec82cb699d8588a614" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } }
I20260808 07:09:35.493412 27403 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1d6581e033c4aec82cb699d8588a614. Latest consensus state: current_term: 1 leader_uuid: "a1d6581e033c4aec82cb699d8588a614" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1d6581e033c4aec82cb699d8588a614" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } } }
I20260808 07:09:35.493485 27403 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:35.493721 27406 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1d6581e033c4aec82cb699d8588a614" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1d6581e033c4aec82cb699d8588a614" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } } }
I20260808 07:09:35.493871 27406 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:35.493870 27412 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:35.494416 27412 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 07:09:35 dist-test-slave-rmhg krb5kdc[27274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 07:09:35.498588 27412 catalog_manager.cc:1347] Generated new cluster ID: ded6037d35bb4baf9eb6522403bc43b1
I20260808 07:09:35.498656 27412 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:35.501720 27402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:35.490581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41467 (local address 127.0.0.1:44233)
0808 07:09:35.490795 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:35.490803 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:35.490830 (+ 27us) server_negotiation.cc:407] Connection header received
0808 07:09:35.491647 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:35.491658 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:35.491729 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:35.491883 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:35.492560 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:35.493947 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:35.494989 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:35.495434 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:35.495540 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:35.497912 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:35.497916 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:35.497916 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:35.497929 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:35.499920 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:35.500460 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:35.500463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:35.500464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:35.500580 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:35.500806 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:35.500807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:35.500808 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:35.501104 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:35.501274 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:35.501421 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 07:09:35.501521 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":111,"threads_started":1}
I20260808 07:09:35.502774 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:35.511160 27402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:35.504280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44169 (local address 127.0.0.1:44233)
0808 07:09:35.504316 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:35.504318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:35.504445 (+ 127us) server_negotiation.cc:407] Connection header received
0808 07:09:35.504499 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:35.504500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:35.504510 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:35.504561 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:35.505183 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:35.505907 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:35.506922 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:35.507238 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:35.507297 (+ 59us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:35.508583 (+ 1286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:35.508584 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:35.508585 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:35.508592 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:35.510032 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:35.510429 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:35.510430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:35.510430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:35.510480 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:35.510684 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:35.510685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:35.510685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:35.510797 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:35.510885 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:35.511015 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 07:09:35.511069 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:09:35.520658 27412 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:35.521458 27412 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:35.533324 27412 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a1d6581e033c4aec82cb699d8588a614: Generated new TSK 0
I20260808 07:09:35.533563 27412 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:35.537869 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 27302
W20260808 07:09:35.553376 27272 connection.cc:535] client connection to 127.0.0.1:44233 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44233): Connection reset by peer (error 104)
2026-08-08T07:09:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1427 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:35 dist-test-slave-rmhg krb5kdc[27449](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:35 dist-test-slave-rmhg krb5kdc[27449](info): set up 2 sockets
Aug 08 07:09:35 dist-test-slave-rmhg krb5kdc[27449](info): commencing operation
krb5kdc: starting...
W20260808 07:09:36.668773 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:36 dist-test-slave-rmhg krb5kdc[27449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:09:36.802024 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45649
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:36.890998 27473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:36.891218 27473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:36.891251 27473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:36.892405 27473 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:36.892448 27473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:36.892477 27473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:36.892493 27473 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:36.892510 27473 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:36.894100 27473 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45649
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:36.894361 27473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:36.894582 27473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:09:36.899497 27473 server_base.cc:1034] running on GCE node
W20260808 07:09:36.899470 27484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:36.899451 27481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:36.899459 27478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:36.899942 27473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:36.900250 27473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:36.901392 27473 hybrid_clock.cc:648] HybridClock initialized: now 1786172976901367 us; error 48 us; skew 500 ppm
Aug 08 07:09:36 dist-test-slave-rmhg krb5kdc[27449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172976, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:36.903877 27473 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:09:36.904326 27473 webserver.cc:460] Webserver started at http://127.0.0.1:43781/ using document root <none> and password file <none>
I20260808 07:09:36.904549 27473 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:36.904600 27473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:36.904728 27473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:36.905818 27473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "20625db0e91f4850ba6be5ddd33d41e0"
format_stamp: "Formatted at 2026-08-08 07:09:36 on dist-test-slave-rmhg"
server_key: "0bf41281ad76cf49308ca2b552102f2a"
server_key_iv: "03bee8f70a4cc38c962d6378b488fd7d"
server_key_version: "encryptionkey@0"
I20260808 07:09:36.906168 27473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "20625db0e91f4850ba6be5ddd33d41e0"
format_stamp: "Formatted at 2026-08-08 07:09:36 on dist-test-slave-rmhg"
server_key: "0bf41281ad76cf49308ca2b552102f2a"
server_key_iv: "03bee8f70a4cc38c962d6378b488fd7d"
server_key_version: "encryptionkey@0"
I20260808 07:09:36.907449 27473 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:09:36.908102 27491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:36.908279 27473 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:36.908367 27473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "20625db0e91f4850ba6be5ddd33d41e0"
format_stamp: "Formatted at 2026-08-08 07:09:36 on dist-test-slave-rmhg"
server_key: "0bf41281ad76cf49308ca2b552102f2a"
server_key_iv: "03bee8f70a4cc38c962d6378b488fd7d"
server_key_version: "encryptionkey@0"
I20260808 07:09:36.908442 27473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:36.926654 27473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:36.928890 27473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:36.929050 27473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:36.932989 27473 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45649
I20260808 07:09:36.933048 27572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45649 every 8 connection(s)
I20260808 07:09:36.933401 27473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:36.934332 27573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:36.936743 27573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0: Bootstrap starting.
I20260808 07:09:36.937400 27573 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:36.937664 27573 log.cc:824] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:36.938431 27573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0: No bootstrap required, opened a new log
I20260808 07:09:36.939016 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 27473
I20260808 07:09:36.939149 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:36.939358 30025 external_mini_cluster.cc:1428] Setting key 21de38ab875ce5631aa6889f783a0500
I20260808 07:09:36.940533 27573 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20625db0e91f4850ba6be5ddd33d41e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45649 } }
I20260808 07:09:36.940724 27573 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:36.940765 27573 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20625db0e91f4850ba6be5ddd33d41e0, State: Initialized, Role: FOLLOWER
I20260808 07:09:36.940907 27573 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20625db0e91f4850ba6be5ddd33d41e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45649 } }
I20260808 07:09:36.940984 27573 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:36.941007 27573 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:36.941057 27573 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:36.941708 27573 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20625db0e91f4850ba6be5ddd33d41e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45649 } }
I20260808 07:09:36.941804 27573 leader_election.cc:302] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20625db0e91f4850ba6be5ddd33d41e0; no voters:
I20260808 07:09:36.941965 27573 leader_election.cc:288] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:36.942016 27583 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:36.942240 27583 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [term 1 LEADER]: Becoming Leader. State: Replica: 20625db0e91f4850ba6be5ddd33d41e0, State: Running, Role: LEADER
I20260808 07:09:36.942255 27573 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:36.942386 27583 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20625db0e91f4850ba6be5ddd33d41e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45649 } }
I20260808 07:09:36.944036 27584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20625db0e91f4850ba6be5ddd33d41e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20625db0e91f4850ba6be5ddd33d41e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45649 } } }
W20260808 07:09:36.944202 27606 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 07:09:36.944108 27585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20625db0e91f4850ba6be5ddd33d41e0. Latest consensus state: current_term: 1 leader_uuid: "20625db0e91f4850ba6be5ddd33d41e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20625db0e91f4850ba6be5ddd33d41e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45649 } } }
I20260808 07:09:36.944252 27584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:36.944257 27585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0 [sys.catalog]: This master's current role is: LEADER
W20260808 07:09:36.944252 27606 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:09:36.944607 27609 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:36.944798 27609 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:36.946135 27581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:36.939974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59265 (local address 127.0.0.1:45649)
0808 07:09:36.940164 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:36.940173 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:36.940201 (+ 28us) server_negotiation.cc:407] Connection header received
0808 07:09:36.940477 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:36.940483 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:36.940532 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:36.940650 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:36.940911 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:36.942405 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:36.943700 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:36.944312 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:36.944441 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:36.945407 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:36.945411 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:36.945411 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:36.945620 (+ 209us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:36.945660 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:36.945676 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:36.945764 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:36.945877 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 07:09:36.945908 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":71,"threads_started":1}
I20260808 07:09:36.946722 27609 catalog_manager.cc:1347] Generated new cluster ID: 0d3a7215f8ab49db925fc35426ffa51b
I20260808 07:09:36.946825 27609 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:36.947110 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:36.951213 27581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:36.948446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32929 (local address 127.0.0.1:45649)
0808 07:09:36.948482 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:36.948484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:36.948596 (+ 112us) server_negotiation.cc:407] Connection header received
0808 07:09:36.948654 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:36.948655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:36.948666 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:36.948711 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:36.948832 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:36.949366 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:36.950068 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:36.950284 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:36.950338 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:36.950974 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:36.950975 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:36.950975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:36.950980 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:36.950996 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:36.951001 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:36.951045 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:36.951120 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 07:09:36.951132 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:09:36.966171 27609 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:36.966952 27609 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:36.981884 27609 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20625db0e91f4850ba6be5ddd33d41e0: Generated new TSK 0
I20260808 07:09:36.982153 27609 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:36.989004 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 27473
W20260808 07:09:36.999502 27446 connection.cc:535] client connection to 127.0.0.1:45649 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45649): Connection reset by peer (error 104)
2026-08-08T07:09:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1446 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:37 dist-test-slave-rmhg krb5kdc[27619](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:37 dist-test-slave-rmhg krb5kdc[27619](info): set up 2 sockets
Aug 08 07:09:37 dist-test-slave-rmhg krb5kdc[27619](info): commencing operation
krb5kdc: starting...
W20260808 07:09:38.109354 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:38 dist-test-slave-rmhg krb5kdc[27619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:09:38.234380 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45321
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45321
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:38.319283 27636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:38.319506 27636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:38.319540 27636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:38.320760 27636 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:38.320806 27636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:38.320824 27636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:38.320839 27636 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:38.320854 27636 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:38.322486 27636 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45321
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:38.322757 27636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:38.322976 27636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:38.327911 27646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:38.327982 27645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:38.328029 27636 server_base.cc:1034] running on GCE node
W20260808 07:09:38.327999 27650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:38.328400 27636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:38.328701 27636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:38.329836 27636 hybrid_clock.cc:648] HybridClock initialized: now 1786172978329821 us; error 31 us; skew 500 ppm
Aug 08 07:09:38 dist-test-slave-rmhg krb5kdc[27619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172978, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:38.332340 27636 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:09:38.332902 27636 webserver.cc:460] Webserver started at http://127.0.0.1:42583/ using document root <none> and password file <none>
I20260808 07:09:38.333190 27636 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:38.333250 27636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:38.333389 27636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:38.334515 27636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "305fb2b1bb6d403cb8750ccd3172bf52"
format_stamp: "Formatted at 2026-08-08 07:09:38 on dist-test-slave-rmhg"
server_key: "6c1d9b38dabf03b2851133a5e71a9a91"
server_key_iv: "b0814503d2884ab3e0ce6170431dcbec"
server_key_version: "encryptionkey@0"
I20260808 07:09:38.334870 27636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "305fb2b1bb6d403cb8750ccd3172bf52"
format_stamp: "Formatted at 2026-08-08 07:09:38 on dist-test-slave-rmhg"
server_key: "6c1d9b38dabf03b2851133a5e71a9a91"
server_key_iv: "b0814503d2884ab3e0ce6170431dcbec"
server_key_version: "encryptionkey@0"
I20260808 07:09:38.336259 27636 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:38.337034 27657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:38.337246 27636 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:38.337347 27636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "305fb2b1bb6d403cb8750ccd3172bf52"
format_stamp: "Formatted at 2026-08-08 07:09:38 on dist-test-slave-rmhg"
server_key: "6c1d9b38dabf03b2851133a5e71a9a91"
server_key_iv: "b0814503d2884ab3e0ce6170431dcbec"
server_key_version: "encryptionkey@0"
I20260808 07:09:38.337412 27636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:38.340904 27636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:38.342917 27636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:38.343062 27636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:38.347031 27636 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45321
I20260808 07:09:38.347072 27743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45321 every 8 connection(s)
I20260808 07:09:38.347402 27636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:38.348412 27747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:38.350384 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 27636
I20260808 07:09:38.350548 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:38.350733 30025 external_mini_cluster.cc:1428] Setting key 4637b112f0952998af3b198fcd30b0bb
I20260808 07:09:38.350898 27747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52: Bootstrap starting.
I20260808 07:09:38.351599 27747 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:38.351877 27747 log.cc:824] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:38.352618 27747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52: No bootstrap required, opened a new log
I20260808 07:09:38.353278 27751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:38.351243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44303 (local address 127.0.0.1:45321)
0808 07:09:38.351440 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:38.351449 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:38.351480 (+ 31us) server_negotiation.cc:407] Connection header received
0808 07:09:38.351927 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:38.351956 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:38.351994 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:38.352138 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:38.352783 (+ 645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:38.352787 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:38.352787 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:38.352791 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:38.352836 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:38.352850 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:38.352913 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:38.353001 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 07:09:38.353044 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":77,"threads_started":1}
I20260808 07:09:38.354259 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:38.355014 27747 raft_consensus.cc:348] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "305fb2b1bb6d403cb8750ccd3172bf52" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } }
I20260808 07:09:38.355218 27747 raft_consensus.cc:374] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:38.355252 27747 raft_consensus.cc:729] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305fb2b1bb6d403cb8750ccd3172bf52, State: Initialized, Role: FOLLOWER
I20260808 07:09:38.355382 27747 consensus_queue.cc:260] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "305fb2b1bb6d403cb8750ccd3172bf52" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } }
I20260808 07:09:38.355487 27747 raft_consensus.cc:388] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:38.355580 27747 raft_consensus.cc:482] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:38.355643 27747 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:38.356458 27747 raft_consensus.cc:504] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "305fb2b1bb6d403cb8750ccd3172bf52" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } }
I20260808 07:09:38.356575 27747 leader_election.cc:302] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 305fb2b1bb6d403cb8750ccd3172bf52; no voters:
I20260808 07:09:38.356745 27747 leader_election.cc:288] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:38.356772 27763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:38.356992 27751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:38.355853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46949 (local address 127.0.0.1:45321)
0808 07:09:38.355888 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:38.355889 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:38.355995 (+ 106us) server_negotiation.cc:407] Connection header received
0808 07:09:38.356020 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:38.356021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:38.356025 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:38.356088 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:38.356623 (+ 535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:38.356624 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:38.356624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:38.356629 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:38.356642 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:38.356646 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:38.356697 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:38.356920 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 07:09:38.356934 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:09:38.357122 27763 raft_consensus.cc:686] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [term 1 LEADER]: Becoming Leader. State: Replica: 305fb2b1bb6d403cb8750ccd3172bf52, State: Running, Role: LEADER
I20260808 07:09:38.357288 27763 consensus_queue.cc:237] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "305fb2b1bb6d403cb8750ccd3172bf52" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } }
I20260808 07:09:38.357453 27747 sys_catalog.cc:564] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:38.357683 27765 sys_catalog.cc:455] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "305fb2b1bb6d403cb8750ccd3172bf52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "305fb2b1bb6d403cb8750ccd3172bf52" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } } }
I20260808 07:09:38.357697 27764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 305fb2b1bb6d403cb8750ccd3172bf52. Latest consensus state: current_term: 1 leader_uuid: "305fb2b1bb6d403cb8750ccd3172bf52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "305fb2b1bb6d403cb8750ccd3172bf52" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } } }
I20260808 07:09:38.357841 27765 sys_catalog.cc:458] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:38.357853 27764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:38.358250 27769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:38.358763 27769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:38.360265 27769 catalog_manager.cc:1347] Generated new cluster ID: f95d337fed9f4b899e9e6e5cd7472d1d
I20260808 07:09:38.360309 27769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:38.366498 27769 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:38.366676 27769 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:38.373446 27769 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 305fb2b1bb6d403cb8750ccd3172bf52: Generated new TSK 0
I20260808 07:09:38.373623 27769 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:38.376368 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 27636
2026-08-08T07:09:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1389 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:38 dist-test-slave-rmhg krb5kdc[27787](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:38 dist-test-slave-rmhg krb5kdc[27787](info): set up 2 sockets
Aug 08 07:09:38 dist-test-slave-rmhg krb5kdc[27787](info): commencing operation
krb5kdc: starting...
W20260808 07:09:39.509626 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:39 dist-test-slave-rmhg krb5kdc[27787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:09:39.635756 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37833
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37833
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:39.720496 27805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:39.720705 27805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:39.720736 27805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:39.721976 27805 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:39.722028 27805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:39.722046 27805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:39.722062 27805 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:39.722078 27805 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:39.723660 27805 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37833
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37833
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:39.723932 27805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:39.724154 27805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:39.728969 27814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:39.729040 27816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:39.729040 27812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:39.729199 27805 server_base.cc:1034] running on GCE node
I20260808 07:09:39.729498 27805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:39.729764 27805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:39.730947 27805 hybrid_clock.cc:648] HybridClock initialized: now 1786172979730919 us; error 32 us; skew 500 ppm
Aug 08 07:09:39 dist-test-slave-rmhg krb5kdc[27787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172979, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:39.733378 27805 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:09:39.733845 27805 webserver.cc:460] Webserver started at http://127.0.0.1:43247/ using document root <none> and password file <none>
I20260808 07:09:39.734082 27805 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:39.734133 27805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:39.734259 27805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:39.735340 27805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "f86b598d3a5b4397b54948ae63b4d07c"
format_stamp: "Formatted at 2026-08-08 07:09:39 on dist-test-slave-rmhg"
server_key: "f699ba3c98a351bfc2ecbf5d88e5c255"
server_key_iv: "a45728bc0a7ffb777a42d274449efbed"
server_key_version: "encryptionkey@0"
I20260808 07:09:39.735679 27805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "f86b598d3a5b4397b54948ae63b4d07c"
format_stamp: "Formatted at 2026-08-08 07:09:39 on dist-test-slave-rmhg"
server_key: "f699ba3c98a351bfc2ecbf5d88e5c255"
server_key_iv: "a45728bc0a7ffb777a42d274449efbed"
server_key_version: "encryptionkey@0"
I20260808 07:09:39.736943 27805 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:39.737679 27831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:39.737835 27805 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:39.737938 27805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "f86b598d3a5b4397b54948ae63b4d07c"
format_stamp: "Formatted at 2026-08-08 07:09:39 on dist-test-slave-rmhg"
server_key: "f699ba3c98a351bfc2ecbf5d88e5c255"
server_key_iv: "a45728bc0a7ffb777a42d274449efbed"
server_key_version: "encryptionkey@0"
I20260808 07:09:39.738005 27805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:39.752760 27805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:39.754920 27805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:39.755093 27805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:39.759111 27805 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37833
I20260808 07:09:39.759156 27925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37833 every 8 connection(s)
I20260808 07:09:39.759621 27805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:39.760532 27927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:39.761723 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 27805
I20260808 07:09:39.761837 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:39.762013 30025 external_mini_cluster.cc:1428] Setting key dcb39016b2897b95e8c69577a2cfe87f
I20260808 07:09:39.763289 27927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c: Bootstrap starting.
I20260808 07:09:39.764060 27927 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:39.764361 27927 log.cc:824] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:39.765098 27927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c: No bootstrap required, opened a new log
I20260808 07:09:39.767411 27927 raft_consensus.cc:348] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f86b598d3a5b4397b54948ae63b4d07c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37833 } }
I20260808 07:09:39.767612 27927 raft_consensus.cc:374] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:39.767666 27927 raft_consensus.cc:729] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86b598d3a5b4397b54948ae63b4d07c, State: Initialized, Role: FOLLOWER
I20260808 07:09:39.767807 27927 consensus_queue.cc:260] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f86b598d3a5b4397b54948ae63b4d07c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37833 } }
I20260808 07:09:39.767892 27927 raft_consensus.cc:388] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:39.767935 27927 raft_consensus.cc:482] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:39.767985 27927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:39.768743 27927 raft_consensus.cc:504] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f86b598d3a5b4397b54948ae63b4d07c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37833 } }
I20260808 07:09:39.768841 27927 leader_election.cc:302] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f86b598d3a5b4397b54948ae63b4d07c; no voters:
I20260808 07:09:39.769006 27927 leader_election.cc:288] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:39.769044 27933 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:39.769240 27933 raft_consensus.cc:686] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [term 1 LEADER]: Becoming Leader. State: Replica: f86b598d3a5b4397b54948ae63b4d07c, State: Running, Role: LEADER
Aug 08 07:09:39 dist-test-slave-rmhg krb5kdc[27787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 07:09:39.769322 27927 sys_catalog.cc:564] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:39.769330 27933 consensus_queue.cc:237] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f86b598d3a5b4397b54948ae63b4d07c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37833 } }
I20260808 07:09:39.769675 27933 sys_catalog.cc:455] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f86b598d3a5b4397b54948ae63b4d07c. Latest consensus state: current_term: 1 leader_uuid: "f86b598d3a5b4397b54948ae63b4d07c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f86b598d3a5b4397b54948ae63b4d07c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37833 } } }
I20260808 07:09:39.769740 27933 sys_catalog.cc:458] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:39.769889 27937 sys_catalog.cc:455] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f86b598d3a5b4397b54948ae63b4d07c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f86b598d3a5b4397b54948ae63b4d07c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37833 } } }
I20260808 07:09:39.770035 27937 sys_catalog.cc:458] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:39.770502 27942 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:39.771183 27942 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:39.773728 27931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:39.762552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40107 (local address 127.0.0.1:37833)
0808 07:09:39.762717 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:39.762725 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:39.762751 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:09:39.763174 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:39.763181 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:39.763230 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:39.763352 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:39.764155 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:39.765315 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:39.766380 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:39.766837 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:39.766936 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:39.770011 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:39.770016 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:39.770016 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:39.770030 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:39.771893 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:39.772338 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:39.772342 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:39.772342 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:39.772475 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:39.772687 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:39.772687 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:39.772688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:39.773025 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:39.773224 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:39.773362 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 07:09:39.773522 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":71,"threads_started":1}
I20260808 07:09:39.773869 27942 catalog_manager.cc:1347] Generated new cluster ID: 9edc433089e34aacbc8f352e9be56df2
I20260808 07:09:39.773936 27942 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:39.774716 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:39.783298 27931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:39.776041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60865 (local address 127.0.0.1:37833)
0808 07:09:39.776100 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:39.776102 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:39.777344 (+ 1242us) server_negotiation.cc:407] Connection header received
0808 07:09:39.777404 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:39.777405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:39.777416 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:39.777462 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:39.778014 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:39.778510 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:39.779296 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:39.779537 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:39.779596 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:39.780756 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:39.780758 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:39.780758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:39.780766 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:39.782227 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:39.782579 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:39.782580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:39.782580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:39.782637 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:39.782804 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:39.782805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:39.782805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:39.782917 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:39.783010 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:39.783116 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 07:09:39.783201 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 07:09:39.814347 27942 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:39.815166 27942 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:39.824995 27942 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f86b598d3a5b4397b54948ae63b4d07c: Generated new TSK 0
I20260808 07:09:39.825243 27942 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:39.835624 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 27805
2026-08-08T07:09:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1459 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:39 dist-test-slave-rmhg krb5kdc[27972](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:39 dist-test-slave-rmhg krb5kdc[27972](info): set up 2 sockets
Aug 08 07:09:39 dist-test-slave-rmhg krb5kdc[27972](info): commencing operation
krb5kdc: starting...
W20260808 07:09:40.968106 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:41 dist-test-slave-rmhg krb5kdc[27972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:09:41.092338 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37907
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37907
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:41.177086 27991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:41.177376 27991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:41.177413 27991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:41.178632 27991 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:41.178678 27991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:41.178695 27991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:41.178712 27991 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:41.178727 27991 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:41.180279 27991 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:41.180545 27991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:41.180768 27991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:41.185732 28007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:41.185774 27999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:41.185882 27991 server_base.cc:1034] running on GCE node
W20260808 07:09:41.185773 28001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:41.186214 27991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:41.186525 27991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:41.187670 27991 hybrid_clock.cc:648] HybridClock initialized: now 1786172981187657 us; error 31 us; skew 500 ppm
Aug 08 07:09:41 dist-test-slave-rmhg krb5kdc[27972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172981, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:41.192891 27991 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:09:41.193442 27991 webserver.cc:460] Webserver started at http://127.0.0.1:39047/ using document root <none> and password file <none>
I20260808 07:09:41.193658 27991 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:41.193708 27991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:41.193833 27991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:41.194924 27991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "f5b9cb6386584423b5b1fd32ec9e2103"
format_stamp: "Formatted at 2026-08-08 07:09:41 on dist-test-slave-rmhg"
server_key: "fa9dc294af85445601886234ad23e2a4"
server_key_iv: "ff6158be6b0c558351f6568933f72396"
server_key_version: "encryptionkey@0"
I20260808 07:09:41.195276 27991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "f5b9cb6386584423b5b1fd32ec9e2103"
format_stamp: "Formatted at 2026-08-08 07:09:41 on dist-test-slave-rmhg"
server_key: "fa9dc294af85445601886234ad23e2a4"
server_key_iv: "ff6158be6b0c558351f6568933f72396"
server_key_version: "encryptionkey@0"
I20260808 07:09:41.196597 27991 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:41.197331 28015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:41.197479 27991 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:41.197574 27991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "f5b9cb6386584423b5b1fd32ec9e2103"
format_stamp: "Formatted at 2026-08-08 07:09:41 on dist-test-slave-rmhg"
server_key: "fa9dc294af85445601886234ad23e2a4"
server_key_iv: "ff6158be6b0c558351f6568933f72396"
server_key_version: "encryptionkey@0"
I20260808 07:09:41.197639 27991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:41.213259 27991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:41.215256 27991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:41.215404 27991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:41.219563 27991 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37907
I20260808 07:09:41.219600 28101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37907 every 8 connection(s)
I20260808 07:09:41.219964 27991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:41.220916 28102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:41.223361 28102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103: Bootstrap starting.
I20260808 07:09:41.223963 28102 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:41.224203 28102 log.cc:824] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:41.224941 28102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103: No bootstrap required, opened a new log
I20260808 07:09:41.226614 28102 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5b9cb6386584423b5b1fd32ec9e2103" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37907 } }
I20260808 07:09:41.226761 28102 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:41.226783 28102 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5b9cb6386584423b5b1fd32ec9e2103, State: Initialized, Role: FOLLOWER
I20260808 07:09:41.226894 28102 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5b9cb6386584423b5b1fd32ec9e2103" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37907 } }
I20260808 07:09:41.226948 28102 raft_consensus.cc:388] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:41.226969 28102 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:41.227005 28102 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:41.227511 28102 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5b9cb6386584423b5b1fd32ec9e2103" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37907 } }
I20260808 07:09:41.227600 28102 leader_election.cc:302] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5b9cb6386584423b5b1fd32ec9e2103; no voters:
I20260808 07:09:41.227736 28102 leader_election.cc:288] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:41.227787 28105 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:41.227972 28105 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [term 1 LEADER]: Becoming Leader. State: Replica: f5b9cb6386584423b5b1fd32ec9e2103, State: Running, Role: LEADER
I20260808 07:09:41.227972 28102 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:41.228099 28105 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5b9cb6386584423b5b1fd32ec9e2103" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37907 } }
I20260808 07:09:41.228407 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 27991
I20260808 07:09:41.228456 28106 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5b9cb6386584423b5b1fd32ec9e2103" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5b9cb6386584423b5b1fd32ec9e2103" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37907 } } }
I20260808 07:09:41.228451 28107 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5b9cb6386584423b5b1fd32ec9e2103. Latest consensus state: current_term: 1 leader_uuid: "f5b9cb6386584423b5b1fd32ec9e2103" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5b9cb6386584423b5b1fd32ec9e2103" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37907 } } }
I20260808 07:09:41.228549 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:41.228544 28106 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:41.228547 28107 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:41.228724 30025 external_mini_cluster.cc:1428] Setting key d0b7e8be85af6e7c2ba2481e8709c88e
I20260808 07:09:41.229698 28111 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:41.230363 28111 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:41.231825 28111 catalog_manager.cc:1347] Generated new cluster ID: c528008be3e641bd892f11d236bb6727
I20260808 07:09:41.231873 28111 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:41.235157 28129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:41.229474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46981 (local address 127.0.0.1:37907)
0808 07:09:41.229623 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:41.229633 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:41.229672 (+ 39us) server_negotiation.cc:407] Connection header received
0808 07:09:41.229801 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:41.229808 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:41.229869 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:41.230056 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:41.230302 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:41.231708 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:41.232888 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:41.233555 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:41.233660 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:41.234423 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:41.234428 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:41.234428 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:41.234648 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:41.234689 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:41.234705 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:41.234761 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:41.234851 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 07:09:41.234918 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":62,"threads_started":1}
I20260808 07:09:41.236393 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:41.245044 28129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:41.241514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43623 (local address 127.0.0.1:37907)
0808 07:09:41.241550 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:41.241552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:41.241709 (+ 157us) server_negotiation.cc:407] Connection header received
0808 07:09:41.241755 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:41.241756 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:41.241769 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:41.241820 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:41.241942 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:41.242716 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:41.243714 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:41.244029 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:41.244096 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:41.244791 (+ 695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:41.244793 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:41.244793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:41.244799 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:41.244818 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:41.244823 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:41.244876 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:41.244923 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 07:09:41.244953 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:09:41.253010 28111 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:41.253824 28111 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:41.272989 28111 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f5b9cb6386584423b5b1fd32ec9e2103: Generated new TSK 0
I20260808 07:09:41.273284 28111 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:41.277848 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 27991
2026-08-08T07:09:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1440 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:41 dist-test-slave-rmhg krb5kdc[28150](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:41 dist-test-slave-rmhg krb5kdc[28150](info): set up 2 sockets
Aug 08 07:09:41 dist-test-slave-rmhg krb5kdc[28150](info): commencing operation
krb5kdc: starting...
W20260808 07:09:42.410900 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:42 dist-test-slave-rmhg krb5kdc[28150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:09:42.535665 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42077
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:42.621284 28170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:42.621534 28170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:42.621573 28170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:42.622826 28170 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:42.622877 28170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:42.622895 28170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:42.622915 28170 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:42.622928 28170 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:42.624567 28170 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:42.624841 28170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:42.625062 28170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:42.629921 28183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:42.629946 28187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:42.629920 28182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:42.630213 28170 server_base.cc:1034] running on GCE node
I20260808 07:09:42.630434 28170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:42.630723 28170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:42.631913 28170 hybrid_clock.cc:648] HybridClock initialized: now 1786172982631889 us; error 29 us; skew 500 ppm
Aug 08 07:09:42 dist-test-slave-rmhg krb5kdc[28150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172982, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:42.634555 28170 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:09:42.635043 28170 webserver.cc:460] Webserver started at http://127.0.0.1:42131/ using document root <none> and password file <none>
I20260808 07:09:42.635357 28170 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:42.635418 28170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:42.635555 28170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:42.636704 28170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "522ac5a4420b450ab15c928ccdbb0592"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-rmhg"
server_key: "f1b7c51e86e8d577558584fa01ee45c0"
server_key_iv: "ecb0edef57abf656beca40145dd9e46f"
server_key_version: "encryptionkey@0"
I20260808 07:09:42.637063 28170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "522ac5a4420b450ab15c928ccdbb0592"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-rmhg"
server_key: "f1b7c51e86e8d577558584fa01ee45c0"
server_key_iv: "ecb0edef57abf656beca40145dd9e46f"
server_key_version: "encryptionkey@0"
I20260808 07:09:42.638427 28170 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:42.639338 28194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:42.639525 28170 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:42.639622 28170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "522ac5a4420b450ab15c928ccdbb0592"
format_stamp: "Formatted at 2026-08-08 07:09:42 on dist-test-slave-rmhg"
server_key: "f1b7c51e86e8d577558584fa01ee45c0"
server_key_iv: "ecb0edef57abf656beca40145dd9e46f"
server_key_version: "encryptionkey@0"
I20260808 07:09:42.639705 28170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:42.643316 28170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:42.645255 28170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:42.645402 28170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:42.649385 28170 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42077
I20260808 07:09:42.649416 28263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42077 every 8 connection(s)
I20260808 07:09:42.649747 28170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:42.650758 28264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:42.651572 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 28170
I20260808 07:09:42.651669 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:42.651837 30025 external_mini_cluster.cc:1428] Setting key db9def34acc2ff5d7fafaed02bc46fea
I20260808 07:09:42.653633 28264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592: Bootstrap starting.
I20260808 07:09:42.654340 28264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:42.654548 28268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:42.652374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37209 (local address 127.0.0.1:42077)
0808 07:09:42.652578 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:42.652588 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:42.652621 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:09:42.653335 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:42.653345 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:42.653382 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:42.653549 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:42.654101 (+ 552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:42.654105 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:42.654105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:42.654109 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:42.654151 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:42.654164 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:42.654247 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:42.654277 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 07:09:42.654318 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":83,"threads_started":1}
I20260808 07:09:42.654688 28264 log.cc:824] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:42.655443 28264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592: No bootstrap required, opened a new log
I20260808 07:09:42.655503 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:42.657812 28264 raft_consensus.cc:348] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "522ac5a4420b450ab15c928ccdbb0592" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42077 } }
I20260808 07:09:42.657974 28264 raft_consensus.cc:374] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:42.658036 28264 raft_consensus.cc:729] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 522ac5a4420b450ab15c928ccdbb0592, State: Initialized, Role: FOLLOWER
I20260808 07:09:42.658231 28268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:42.657070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45977 (local address 127.0.0.1:42077)
0808 07:09:42.657109 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:42.657111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:42.657262 (+ 151us) server_negotiation.cc:407] Connection header received
0808 07:09:42.657326 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:42.657326 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:42.657332 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:42.657385 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:42.657911 (+ 526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:42.657912 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:42.657912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:42.657916 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:42.657931 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:42.657936 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:42.657995 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:42.658138 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 07:09:42.658153 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:09:42.658169 28264 consensus_queue.cc:260] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "522ac5a4420b450ab15c928ccdbb0592" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42077 } }
I20260808 07:09:42.658291 28264 raft_consensus.cc:388] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:42.658327 28264 raft_consensus.cc:482] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:42.658377 28264 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:42.658979 28264 raft_consensus.cc:504] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "522ac5a4420b450ab15c928ccdbb0592" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42077 } }
I20260808 07:09:42.659088 28264 leader_election.cc:302] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 522ac5a4420b450ab15c928ccdbb0592; no voters:
I20260808 07:09:42.659237 28264 leader_election.cc:288] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:42.659273 28282 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:42.659426 28282 raft_consensus.cc:686] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [term 1 LEADER]: Becoming Leader. State: Replica: 522ac5a4420b450ab15c928ccdbb0592, State: Running, Role: LEADER
I20260808 07:09:42.659471 28264 sys_catalog.cc:564] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:42.659516 28282 consensus_queue.cc:237] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "522ac5a4420b450ab15c928ccdbb0592" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42077 } }
I20260808 07:09:42.659896 28283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "522ac5a4420b450ab15c928ccdbb0592" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "522ac5a4420b450ab15c928ccdbb0592" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42077 } } }
I20260808 07:09:42.660009 28283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:42.659893 28284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 522ac5a4420b450ab15c928ccdbb0592. Latest consensus state: current_term: 1 leader_uuid: "522ac5a4420b450ab15c928ccdbb0592" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "522ac5a4420b450ab15c928ccdbb0592" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42077 } } }
I20260808 07:09:42.660185 28284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:42.660463 28294 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:42.660931 28294 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:42.662487 28294 catalog_manager.cc:1347] Generated new cluster ID: c32e09e9ac584787a4db0c94a7a93bc7
I20260808 07:09:42.662539 28294 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:42.678792 28294 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:42.678972 28294 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:42.683899 28294 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 522ac5a4420b450ab15c928ccdbb0592: Generated new TSK 0
I20260808 07:09:42.684082 28294 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:42.688519 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 28170
2026-08-08T07:09:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1414 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:42 dist-test-slave-rmhg krb5kdc[28311](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:42 dist-test-slave-rmhg krb5kdc[28311](info): set up 2 sockets
Aug 08 07:09:42 dist-test-slave-rmhg krb5kdc[28311](info): commencing operation
krb5kdc: starting...
W20260808 07:09:43.813395 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:43 dist-test-slave-rmhg krb5kdc[28311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172983, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:09:43.939397 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34445
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:44.023742 28332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:44.023960 28332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:44.023984 28332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:44.025251 28332 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:44.025296 28332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:44.025309 28332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:44.025321 28332 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:44.025331 28332 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:44.026847 28332 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:44.027096 28332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:44.027307 28332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:44.032188 28338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:44.032177 28339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:44.032236 28332 server_base.cc:1034] running on GCE node
W20260808 07:09:44.032235 28342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:44.032603 28332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:44.032867 28332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:44.034039 28332 hybrid_clock.cc:648] HybridClock initialized: now 1786172984034020 us; error 33 us; skew 500 ppm
Aug 08 07:09:44 dist-test-slave-rmhg krb5kdc[28311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172984, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:44.036514 28332 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:09:44.036996 28332 webserver.cc:460] Webserver started at http://127.0.0.1:39569/ using document root <none> and password file <none>
I20260808 07:09:44.037263 28332 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:44.037317 28332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:44.037446 28332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:44.038482 28332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "38d8b49cb8a2455db829bd589975d96b"
format_stamp: "Formatted at 2026-08-08 07:09:44 on dist-test-slave-rmhg"
server_key: "ff54339003c2e6488e570feafb202b91"
server_key_iv: "da057ba8a6888d41a6e42fa794265ea4"
server_key_version: "encryptionkey@0"
I20260808 07:09:44.038831 28332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "38d8b49cb8a2455db829bd589975d96b"
format_stamp: "Formatted at 2026-08-08 07:09:44 on dist-test-slave-rmhg"
server_key: "ff54339003c2e6488e570feafb202b91"
server_key_iv: "da057ba8a6888d41a6e42fa794265ea4"
server_key_version: "encryptionkey@0"
I20260808 07:09:44.040112 28332 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:44.040834 28349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:44.040987 28332 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:44.041077 28332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "38d8b49cb8a2455db829bd589975d96b"
format_stamp: "Formatted at 2026-08-08 07:09:44 on dist-test-slave-rmhg"
server_key: "ff54339003c2e6488e570feafb202b91"
server_key_iv: "da057ba8a6888d41a6e42fa794265ea4"
server_key_version: "encryptionkey@0"
I20260808 07:09:44.041143 28332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:44.057294 28332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:44.059613 28332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:44.059767 28332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:44.063934 28332 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34445
I20260808 07:09:44.064028 28425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34445 every 8 connection(s)
I20260808 07:09:44.064360 28332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:44.065285 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 28332
I20260808 07:09:44.065400 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:44.065387 28426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:44.065629 30025 external_mini_cluster.cc:1428] Setting key d57e19ba29e8cc62a47d25c0d10a01bb
I20260808 07:09:44.068950 28426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b: Bootstrap starting.
I20260808 07:09:44.069741 28426 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:44.070050 28426 log.cc:824] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:44.070778 28426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b: No bootstrap required, opened a new log
Aug 08 07:09:44 dist-test-slave-rmhg krb5kdc[28311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172983, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 07:09:44.072925 28426 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38d8b49cb8a2455db829bd589975d96b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34445 } }
I20260808 07:09:44.073066 28426 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:44.073103 28426 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38d8b49cb8a2455db829bd589975d96b, State: Initialized, Role: FOLLOWER
I20260808 07:09:44.073277 28426 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38d8b49cb8a2455db829bd589975d96b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34445 } }
I20260808 07:09:44.073349 28426 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:44.073372 28426 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:44.073419 28426 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:44.074199 28426 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38d8b49cb8a2455db829bd589975d96b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34445 } }
I20260808 07:09:44.074322 28426 leader_election.cc:302] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38d8b49cb8a2455db829bd589975d96b; no voters:
I20260808 07:09:44.074515 28426 leader_election.cc:288] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:44.074577 28433 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:44.074783 28433 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [term 1 LEADER]: Becoming Leader. State: Replica: 38d8b49cb8a2455db829bd589975d96b, State: Running, Role: LEADER
I20260808 07:09:44.074836 28426 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:44.074950 28433 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38d8b49cb8a2455db829bd589975d96b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34445 } }
I20260808 07:09:44.075297 28433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38d8b49cb8a2455db829bd589975d96b. Latest consensus state: current_term: 1 leader_uuid: "38d8b49cb8a2455db829bd589975d96b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38d8b49cb8a2455db829bd589975d96b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34445 } } }
I20260808 07:09:44.075376 28433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:44.075532 28436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38d8b49cb8a2455db829bd589975d96b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38d8b49cb8a2455db829bd589975d96b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34445 } } }
I20260808 07:09:44.075594 28436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b [sys.catalog]: This master's current role is: LEADER
W20260808 07:09:44.076689 28460 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:09:44.076749 28460 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:09:44.076790 28445 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:44.076937 28445 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:44.077494 28430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:44.066354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:52657 (local address 127.0.0.1:34445)
0808 07:09:44.066574 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:44.066584 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:44.066621 (+ 37us) server_negotiation.cc:407] Connection header received
0808 07:09:44.067105 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:44.067115 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:44.067203 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:44.067369 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:44.068315 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.069712 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.070526 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.071140 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.071259 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:44.073663 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:44.073668 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:44.073668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:44.073682 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:44.075631 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:44.076081 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:44.076085 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:44.076086 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:44.076213 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:44.076497 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:44.076499 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:44.076499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:44.076759 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:44.076906 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:44.077173 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 07:09:44.077280 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":89,"threads_started":1}
I20260808 07:09:44.078472 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:44.078766 28445 catalog_manager.cc:1347] Generated new cluster ID: 24770dc1d1754cc3a3a04c62225fb903
I20260808 07:09:44.078823 28445 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:44.087122 28445 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:44.087841 28445 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:44.091262 28430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:44.081527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:40775 (local address 127.0.0.1:34445)
0808 07:09:44.081564 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:44.081566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:44.085316 (+ 3750us) server_negotiation.cc:407] Connection header received
0808 07:09:44.085382 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:44.085383 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:44.085394 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:44.085440 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:44.085980 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.086470 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.087389 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:44.087623 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:44.087680 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:44.088881 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:44.088882 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:44.088883 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:44.088890 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:44.090195 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:44.090533 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:44.090534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:44.090534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:44.090584 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:44.090777 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:44.090778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:44.090779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:44.090880 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:44.090969 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:44.091101 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 07:09:44.091174 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":17}
I20260808 07:09:44.093719 28445 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38d8b49cb8a2455db829bd589975d96b: Generated new TSK 0
I20260808 07:09:44.093910 28445 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:44.099153 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 28332
W20260808 07:09:44.116520 28309 connection.cc:535] client connection to 127.0.0.1:34445 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34445): Connection reset by peer (error 104)
2026-08-08T07:09:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1412 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:44 dist-test-slave-rmhg krb5kdc[28478](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:44 dist-test-slave-rmhg krb5kdc[28478](info): set up 2 sockets
Aug 08 07:09:44 dist-test-slave-rmhg krb5kdc[28478](info): commencing operation
krb5kdc: starting...
W20260808 07:09:45.222112 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:45 dist-test-slave-rmhg krb5kdc[28478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:09:45.348030 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46057
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46057
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:45.433123 28502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:45.433401 28502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:45.433439 28502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:45.434670 28502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:45.434719 28502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:45.434737 28502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:45.434756 28502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:45.434772 28502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:45.436376 28502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:45.436638 28502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:45.436868 28502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:45.441884 28508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:45.441890 28514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:45.441895 28512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:45.442234 28502 server_base.cc:1034] running on GCE node
I20260808 07:09:45.442479 28502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:45.442787 28502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:45.443938 28502 hybrid_clock.cc:648] HybridClock initialized: now 1786172985443919 us; error 33 us; skew 500 ppm
Aug 08 07:09:45 dist-test-slave-rmhg krb5kdc[28478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172985, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:45.446530 28502 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:09:45.447032 28502 webserver.cc:460] Webserver started at http://127.0.0.1:45899/ using document root <none> and password file <none>
I20260808 07:09:45.447269 28502 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:45.447319 28502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:45.447454 28502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:45.448542 28502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "4807124649c245de999375456a3f85c2"
format_stamp: "Formatted at 2026-08-08 07:09:45 on dist-test-slave-rmhg"
server_key: "a74d9393e5d91f5ced5c75526a3f33b9"
server_key_iv: "675d5387dc3ad21192b3504599f7fab7"
server_key_version: "encryptionkey@0"
I20260808 07:09:45.448930 28502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "4807124649c245de999375456a3f85c2"
format_stamp: "Formatted at 2026-08-08 07:09:45 on dist-test-slave-rmhg"
server_key: "a74d9393e5d91f5ced5c75526a3f33b9"
server_key_iv: "675d5387dc3ad21192b3504599f7fab7"
server_key_version: "encryptionkey@0"
I20260808 07:09:45.450340 28502 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:45.451146 28529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:45.451309 28502 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:45.451401 28502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "4807124649c245de999375456a3f85c2"
format_stamp: "Formatted at 2026-08-08 07:09:45 on dist-test-slave-rmhg"
server_key: "a74d9393e5d91f5ced5c75526a3f33b9"
server_key_iv: "675d5387dc3ad21192b3504599f7fab7"
server_key_version: "encryptionkey@0"
I20260808 07:09:45.451470 28502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:45.481124 28502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:45.483448 28502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:45.483614 28502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:45.487703 28502 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46057
I20260808 07:09:45.487744 28609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46057 every 8 connection(s)
I20260808 07:09:45.488103 28502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:45.489076 28611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:45.491588 28611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2: Bootstrap starting.
I20260808 07:09:45.492209 28611 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:45.492477 28611 log.cc:824] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:45.493302 28611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2: No bootstrap required, opened a new log
I20260808 07:09:45.494607 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 28502
I20260808 07:09:45.494736 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:45.494935 30025 external_mini_cluster.cc:1428] Setting key 8d67b9b9cff33576c7765f7840151993
I20260808 07:09:45.495236 28611 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4807124649c245de999375456a3f85c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46057 } }
I20260808 07:09:45.495414 28611 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:45.495457 28611 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4807124649c245de999375456a3f85c2, State: Initialized, Role: FOLLOWER
I20260808 07:09:45.495656 28611 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4807124649c245de999375456a3f85c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46057 } }
I20260808 07:09:45.495752 28611 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:45.495795 28611 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:45.495849 28611 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:45.496531 28611 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4807124649c245de999375456a3f85c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46057 } }
I20260808 07:09:45.496636 28611 leader_election.cc:302] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4807124649c245de999375456a3f85c2; no voters:
I20260808 07:09:45.496796 28611 leader_election.cc:288] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:45.496843 28619 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:45.496996 28619 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [term 1 LEADER]: Becoming Leader. State: Replica: 4807124649c245de999375456a3f85c2, State: Running, Role: LEADER
I20260808 07:09:45.497064 28611 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:45.497126 28619 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4807124649c245de999375456a3f85c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46057 } }
I20260808 07:09:45.497576 28619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4807124649c245de999375456a3f85c2. Latest consensus state: current_term: 1 leader_uuid: "4807124649c245de999375456a3f85c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4807124649c245de999375456a3f85c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46057 } } }
I20260808 07:09:45.497641 28619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:45.498145 28620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4807124649c245de999375456a3f85c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4807124649c245de999375456a3f85c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46057 } } }
I20260808 07:09:45.498221 28620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:45.498543 28626 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:45.499048 28626 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:45.500874 28626 catalog_manager.cc:1347] Generated new cluster ID: 4e704996cd064e4f9994988a91b1a25e
I20260808 07:09:45.500919 28626 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:45.501344 28616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:45.495520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:52357 (local address 127.0.0.1:46057)
0808 07:09:45.495735 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:45.495742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:45.495771 (+ 29us) server_negotiation.cc:407] Connection header received
0808 07:09:45.495905 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:45.495912 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:45.495983 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:45.496105 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:45.496402 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:45.498006 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:45.499063 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:45.499649 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:45.499759 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:45.500486 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:45.500490 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:45.500490 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:45.500714 (+ 224us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:45.500754 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:45.500769 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:45.500852 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:45.501065 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 07:09:45.501096 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":99,"threads_started":1}
I20260808 07:09:45.502413 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:45.507493 28616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:45.504005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:32885 (local address 127.0.0.1:46057)
0808 07:09:45.504045 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:45.504046 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:45.504079 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:09:45.504153 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:45.504154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:45.504164 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:45.504212 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:45.504330 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:45.505132 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:45.506156 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:45.506492 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:45.506567 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:45.507243 (+ 676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:45.507245 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:45.507245 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:45.507250 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:45.507269 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:45.507274 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:45.507336 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:45.507395 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 07:09:45.507408 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:09:45.513051 28626 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:45.513820 28626 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:45.518805 28626 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4807124649c245de999375456a3f85c2: Generated new TSK 0
I20260808 07:09:45.519038 28626 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:45.523522 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 28502
W20260808 07:09:45.539177 28474 connection.cc:535] client connection to 127.0.0.1:46057 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46057): Connection reset by peer (error 104)
2026-08-08T07:09:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1422 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:45 dist-test-slave-rmhg krb5kdc[28651](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:45 dist-test-slave-rmhg krb5kdc[28651](info): set up 2 sockets
Aug 08 07:09:45 dist-test-slave-rmhg krb5kdc[28651](info): commencing operation
krb5kdc: starting...
W20260808 07:09:46.663503 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:46 dist-test-slave-rmhg krb5kdc[28651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172986, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:09:46.792299 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40371
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40371
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:46.895980 28670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:46.896219 28670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:46.896243 28670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:46.897555 28670 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:46.897607 28670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:46.897620 28670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:46.897632 28670 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:46.897642 28670 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:46.899242 28670 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40371
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:46.899520 28670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:46.899744 28670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:46.904816 28680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:46.904743 28677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:46.904877 28670 server_base.cc:1034] running on GCE node
W20260808 07:09:46.904742 28678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:46.905259 28670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:46.905534 28670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:46.906705 28670 hybrid_clock.cc:648] HybridClock initialized: now 1786172986906691 us; error 29 us; skew 500 ppm
Aug 08 07:09:46 dist-test-slave-rmhg krb5kdc[28651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172986, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:46.909376 28670 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:09:46.909870 28670 webserver.cc:460] Webserver started at http://127.0.0.1:43299/ using document root <none> and password file <none>
I20260808 07:09:46.910085 28670 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:46.910152 28670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:46.910279 28670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:46.911358 28670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "3a75b7e682b0483186aa2be1fdb4dc2b"
format_stamp: "Formatted at 2026-08-08 07:09:46 on dist-test-slave-rmhg"
server_key: "69f7668d9099078a19dc05a07e5798ce"
server_key_iv: "474a436de9a8e44868925e85f789ec4f"
server_key_version: "encryptionkey@0"
I20260808 07:09:46.911708 28670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "3a75b7e682b0483186aa2be1fdb4dc2b"
format_stamp: "Formatted at 2026-08-08 07:09:46 on dist-test-slave-rmhg"
server_key: "69f7668d9099078a19dc05a07e5798ce"
server_key_iv: "474a436de9a8e44868925e85f789ec4f"
server_key_version: "encryptionkey@0"
I20260808 07:09:46.913055 28670 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:46.913950 28692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:46.914140 28670 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:46.914237 28670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "3a75b7e682b0483186aa2be1fdb4dc2b"
format_stamp: "Formatted at 2026-08-08 07:09:46 on dist-test-slave-rmhg"
server_key: "69f7668d9099078a19dc05a07e5798ce"
server_key_iv: "474a436de9a8e44868925e85f789ec4f"
server_key_version: "encryptionkey@0"
I20260808 07:09:46.914302 28670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:46.917740 28670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:46.919657 28670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:46.919795 28670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:46.923774 28670 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40371
I20260808 07:09:46.923805 28769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40371 every 8 connection(s)
I20260808 07:09:46.924149 28670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:46.925268 28770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:46.927656 28770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b: Bootstrap starting.
I20260808 07:09:46.928259 28770 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:46.928574 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 28670
I20260808 07:09:46.928586 28770 log.cc:824] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:46.928697 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:46.928872 30025 external_mini_cluster.cc:1428] Setting key 43dd4ca7bab32da033f62f8a547db2e4
I20260808 07:09:46.929442 28770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b: No bootstrap required, opened a new log
I20260808 07:09:46.931383 28770 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a75b7e682b0483186aa2be1fdb4dc2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40371 } }
I20260808 07:09:46.931561 28770 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:46.931603 28770 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a75b7e682b0483186aa2be1fdb4dc2b, State: Initialized, Role: FOLLOWER
I20260808 07:09:46.931739 28770 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a75b7e682b0483186aa2be1fdb4dc2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40371 } }
I20260808 07:09:46.931825 28770 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:46.931859 28770 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:46.931907 28770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:46.932128 28776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:46.929413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:60251 (local address 127.0.0.1:40371)
0808 07:09:46.929664 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:46.929674 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:46.929703 (+ 29us) server_negotiation.cc:407] Connection header received
0808 07:09:46.930619 (+ 916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:46.930628 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:46.930670 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:46.930806 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:46.931590 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:46.931593 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:46.931594 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:46.931598 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:46.931651 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:46.931667 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:46.931730 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:46.931798 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 07:09:46.931938 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":77,"threads_started":1}
I20260808 07:09:46.932858 28770 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a75b7e682b0483186aa2be1fdb4dc2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40371 } }
I20260808 07:09:46.932973 28770 leader_election.cc:302] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a75b7e682b0483186aa2be1fdb4dc2b; no voters:
I20260808 07:09:46.933053 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:46.933230 28777 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:46.933238 28770 leader_election.cc:288] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:46.933393 28777 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [term 1 LEADER]: Becoming Leader. State: Replica: 3a75b7e682b0483186aa2be1fdb4dc2b, State: Running, Role: LEADER
I20260808 07:09:46.933557 28770 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:46.933537 28777 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a75b7e682b0483186aa2be1fdb4dc2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40371 } }
I20260808 07:09:46.933888 28777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a75b7e682b0483186aa2be1fdb4dc2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a75b7e682b0483186aa2be1fdb4dc2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40371 } } }
I20260808 07:09:46.933938 28779 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a75b7e682b0483186aa2be1fdb4dc2b. Latest consensus state: current_term: 1 leader_uuid: "3a75b7e682b0483186aa2be1fdb4dc2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a75b7e682b0483186aa2be1fdb4dc2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40371 } } }
I20260808 07:09:46.934026 28777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:46.934031 28779 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:46.934585 28787 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:46.935210 28787 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:46.936209 28776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:46.934654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:43203 (local address 127.0.0.1:40371)
0808 07:09:46.934688 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:46.934690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:46.935307 (+ 617us) server_negotiation.cc:407] Connection header received
0808 07:09:46.935331 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:46.935332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:46.935338 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:46.935383 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:46.935962 (+ 579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:46.935963 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:46.935964 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:46.935968 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:46.935999 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:46.936004 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:46.936051 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:46.936139 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 07:09:46.936153 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:09:46.937194 28787 catalog_manager.cc:1347] Generated new cluster ID: cd9d072e038a441b90277f66866ce4de
I20260808 07:09:46.937245 28787 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:46.946990 28787 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:46.947221 28787 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:46.957641 28787 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a75b7e682b0483186aa2be1fdb4dc2b: Generated new TSK 0
I20260808 07:09:46.957913 28787 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:46.964433 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 28670
2026-08-08T07:09:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1439 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:47 dist-test-slave-rmhg krb5kdc[28815](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:47 dist-test-slave-rmhg krb5kdc[28815](info): set up 2 sockets
Aug 08 07:09:47 dist-test-slave-rmhg krb5kdc[28815](info): commencing operation
krb5kdc: starting...
W20260808 07:09:48.090761 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:48 dist-test-slave-rmhg krb5kdc[28815](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:09:48.210224 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44795
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:48.294065 28829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:48.294301 28829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:48.294324 28829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:48.295593 28829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:48.295648 28829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:48.295661 28829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:48.295672 28829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:48.295686 28829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:48.297303 28829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44795
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:48.297556 28829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:48.297799 28829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:09:48.303295 28829 server_base.cc:1034] running on GCE node
W20260808 07:09:48.303279 28840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:48.303283 28836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:48.303432 28834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:48.303807 28829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:48.304118 28829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:48.305231 28829 hybrid_clock.cc:648] HybridClock initialized: now 1786172988305201 us; error 51 us; skew 500 ppm
Aug 08 07:09:48 dist-test-slave-rmhg krb5kdc[28815](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172988, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:48.307701 28829 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:09:48.308164 28829 webserver.cc:460] Webserver started at http://127.0.0.1:44321/ using document root <none> and password file <none>
I20260808 07:09:48.308372 28829 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:48.308420 28829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:48.308553 28829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:48.309677 28829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "63642676ad994a14aa5f5d754fa9bd47"
format_stamp: "Formatted at 2026-08-08 07:09:48 on dist-test-slave-rmhg"
server_key: "49278b489bf0a2d1f1f662c886505e16"
server_key_iv: "58e7b68a9b12cea2ff15e4be612a36ba"
server_key_version: "encryptionkey@0"
I20260808 07:09:48.310016 28829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "63642676ad994a14aa5f5d754fa9bd47"
format_stamp: "Formatted at 2026-08-08 07:09:48 on dist-test-slave-rmhg"
server_key: "49278b489bf0a2d1f1f662c886505e16"
server_key_iv: "58e7b68a9b12cea2ff15e4be612a36ba"
server_key_version: "encryptionkey@0"
I20260808 07:09:48.311314 28829 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:09:48.312248 28850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:48.312503 28829 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:09:48.312695 28829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "63642676ad994a14aa5f5d754fa9bd47"
format_stamp: "Formatted at 2026-08-08 07:09:48 on dist-test-slave-rmhg"
server_key: "49278b489bf0a2d1f1f662c886505e16"
server_key_iv: "58e7b68a9b12cea2ff15e4be612a36ba"
server_key_version: "encryptionkey@0"
I20260808 07:09:48.312798 28829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:48.322558 28829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:48.324319 28829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:48.324477 28829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:48.328368 28829 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44795
I20260808 07:09:48.328418 28930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44795 every 8 connection(s)
I20260808 07:09:48.328769 28829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:48.329730 28931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:48.332093 28931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47: Bootstrap starting.
I20260808 07:09:48.332685 28931 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:48.332950 28931 log.cc:824] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:48.333739 28931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47: No bootstrap required, opened a new log
I20260808 07:09:48.335352 28931 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63642676ad994a14aa5f5d754fa9bd47" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44795 } }
I20260808 07:09:48.335502 28931 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:48.335525 28931 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63642676ad994a14aa5f5d754fa9bd47, State: Initialized, Role: FOLLOWER
I20260808 07:09:48.335722 28931 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63642676ad994a14aa5f5d754fa9bd47" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44795 } }
I20260808 07:09:48.335783 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 28829
I20260808 07:09:48.335811 28931 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:48.335837 28931 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:48.335886 28931 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:48.335901 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:48.336064 30025 external_mini_cluster.cc:1428] Setting key 630da162b1da88fbdbdc48e2ac7a743c
I20260808 07:09:48.336520 28931 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63642676ad994a14aa5f5d754fa9bd47" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44795 } }
I20260808 07:09:48.336652 28931 leader_election.cc:302] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63642676ad994a14aa5f5d754fa9bd47; no voters:
I20260808 07:09:48.336879 28931 leader_election.cc:288] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:48.336925 28936 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:48.337028 28936 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [term 1 LEADER]: Becoming Leader. State: Replica: 63642676ad994a14aa5f5d754fa9bd47, State: Running, Role: LEADER
I20260808 07:09:48.337196 28931 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:48.337206 28936 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63642676ad994a14aa5f5d754fa9bd47" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44795 } }
I20260808 07:09:48.337827 28937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63642676ad994a14aa5f5d754fa9bd47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63642676ad994a14aa5f5d754fa9bd47" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44795 } } }
I20260808 07:09:48.337913 28937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:48.338351 28938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63642676ad994a14aa5f5d754fa9bd47. Latest consensus state: current_term: 1 leader_uuid: "63642676ad994a14aa5f5d754fa9bd47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63642676ad994a14aa5f5d754fa9bd47" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44795 } } }
I20260808 07:09:48.338433 28938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47 [sys.catalog]: This master's current role is: LEADER
W20260808 07:09:48.339001 28954 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:09:48.339046 28954 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:09:48.339092 28946 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:48.339269 28946 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:48.341589 28946 catalog_manager.cc:1347] Generated new cluster ID: 7cccf246fa2a4a8da25ae2ee5d12d121
I20260808 07:09:48.341645 28946 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:09:48 dist-test-slave-rmhg krb5kdc[28815](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 07:09:48.347110 28935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.336592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:38583 (local address 127.0.0.1:44795)
0808 07:09:48.336766 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:48.336777 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:48.336814 (+ 37us) server_negotiation.cc:407] Connection header received
0808 07:09:48.336917 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:48.336924 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:48.336986 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:48.337882 (+ 896us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:48.338020 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.339490 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.340433 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.341035 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.341169 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.343453 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:48.343458 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:48.343459 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:48.343471 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:48.345219 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.345733 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.345736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.345737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.345853 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.346076 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.346077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.346077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.346375 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:48.346534 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:48.346668 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 07:09:48.346876 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260808 07:09:48.348045 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:48.352250 28946 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:48.352856 28946 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:48.356424 28935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:48.349622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:33605 (local address 127.0.0.1:44795)
0808 07:09:48.349663 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:48.349665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:48.349775 (+ 110us) server_negotiation.cc:407] Connection header received
0808 07:09:48.349824 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:48.349825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:48.349836 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:48.349887 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:48.350442 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.351185 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.352083 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:48.352408 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:48.352477 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:48.353842 (+ 1365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:48.353843 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:48.353844 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:48.353851 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:48.355323 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.355706 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.355707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.355707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.355766 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:48.355949 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:48.355949 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:48.355950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:48.356071 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:48.356168 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:48.356267 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 07:09:48.356331 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":19}
I20260808 07:09:48.367213 28946 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63642676ad994a14aa5f5d754fa9bd47: Generated new TSK 0
I20260808 07:09:48.367466 28946 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:48.376107 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 28829
W20260808 07:09:48.390268 28813 connection.cc:535] client connection to 127.0.0.1:44795 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44795): Connection reset by peer (error 104)
2026-08-08T07:09:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1411 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:48 dist-test-slave-rmhg krb5kdc[28968](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:48 dist-test-slave-rmhg krb5kdc[28968](info): set up 2 sockets
Aug 08 07:09:48 dist-test-slave-rmhg krb5kdc[28968](info): commencing operation
krb5kdc: starting...
W20260808 07:09:49.514948 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:49 dist-test-slave-rmhg krb5kdc[28968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:09:49.640709 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45355
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:49.725786 28989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:49.726008 28989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:49.726032 28989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:49.727211 28989 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:49.727259 28989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:49.727272 28989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:49.727283 28989 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:49.727295 28989 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:49.728884 28989 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45355
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:49.729188 28989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:49.729415 28989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:49.734403 28996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:49.734372 29001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:49.734421 28989 server_base.cc:1034] running on GCE node
W20260808 07:09:49.734373 28999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:49.734886 28989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:49.735172 28989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:49.736346 28989 hybrid_clock.cc:648] HybridClock initialized: now 1786172989736323 us; error 29 us; skew 500 ppm
Aug 08 07:09:49 dist-test-slave-rmhg krb5kdc[28968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172989, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:49.738941 28989 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:09:49.739384 28989 webserver.cc:460] Webserver started at http://127.0.0.1:41373/ using document root <none> and password file <none>
I20260808 07:09:49.739614 28989 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:49.739665 28989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:49.739795 28989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:49.740839 28989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "8942ee44fdc5476c829a0f4d313169ab"
format_stamp: "Formatted at 2026-08-08 07:09:49 on dist-test-slave-rmhg"
server_key: "72335a90901c6aa22c2c17446bf1a5c3"
server_key_iv: "6b4df1e1961ca33bbb884f591b83b58e"
server_key_version: "encryptionkey@0"
I20260808 07:09:49.741216 28989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "8942ee44fdc5476c829a0f4d313169ab"
format_stamp: "Formatted at 2026-08-08 07:09:49 on dist-test-slave-rmhg"
server_key: "72335a90901c6aa22c2c17446bf1a5c3"
server_key_iv: "6b4df1e1961ca33bbb884f591b83b58e"
server_key_version: "encryptionkey@0"
I20260808 07:09:49.742599 28989 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:49.743381 29008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:49.743592 28989 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:09:49.743690 28989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "8942ee44fdc5476c829a0f4d313169ab"
format_stamp: "Formatted at 2026-08-08 07:09:49 on dist-test-slave-rmhg"
server_key: "72335a90901c6aa22c2c17446bf1a5c3"
server_key_iv: "6b4df1e1961ca33bbb884f591b83b58e"
server_key_version: "encryptionkey@0"
I20260808 07:09:49.743757 28989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:49.764531 28989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:49.766789 28989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:49.766935 28989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:49.771226 28989 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45355
I20260808 07:09:49.771265 29088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45355 every 8 connection(s)
I20260808 07:09:49.771629 28989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:49.772508 29089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:49.774928 29089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab: Bootstrap starting.
I20260808 07:09:49.775530 29089 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:49.775796 29089 log.cc:824] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:49.776559 29089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab: No bootstrap required, opened a new log
I20260808 07:09:49.776940 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 28989
I20260808 07:09:49.777057 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:49.777264 30025 external_mini_cluster.cc:1428] Setting key 581970baba36408806063d6e41db8fe9
I20260808 07:09:49.778504 29089 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8942ee44fdc5476c829a0f4d313169ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45355 } }
I20260808 07:09:49.778685 29089 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:49.778725 29089 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8942ee44fdc5476c829a0f4d313169ab, State: Initialized, Role: FOLLOWER
I20260808 07:09:49.778892 29089 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8942ee44fdc5476c829a0f4d313169ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45355 } }
I20260808 07:09:49.778998 29089 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:49.779033 29089 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:49.779081 29089 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:49.779838 29089 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8942ee44fdc5476c829a0f4d313169ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45355 } }
I20260808 07:09:49.779951 29089 leader_election.cc:302] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8942ee44fdc5476c829a0f4d313169ab; no voters:
I20260808 07:09:49.780119 29089 leader_election.cc:288] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:49.780169 29094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:49.780349 29094 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [term 1 LEADER]: Becoming Leader. State: Replica: 8942ee44fdc5476c829a0f4d313169ab, State: Running, Role: LEADER
I20260808 07:09:49.780445 29089 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:49.780488 29094 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8942ee44fdc5476c829a0f4d313169ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45355 } }
I20260808 07:09:49.780882 29094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8942ee44fdc5476c829a0f4d313169ab. Latest consensus state: current_term: 1 leader_uuid: "8942ee44fdc5476c829a0f4d313169ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8942ee44fdc5476c829a0f4d313169ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45355 } } }
I20260808 07:09:49.781021 29094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:49.781314 29106 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:49.781941 29106 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:49.782176 29097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8942ee44fdc5476c829a0f4d313169ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8942ee44fdc5476c829a0f4d313169ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45355 } } }
I20260808 07:09:49.782245 29097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:49.783529 29106 catalog_manager.cc:1347] Generated new cluster ID: 63e0aad09e3a44a98a1b62f7864999f9
I20260808 07:09:49.783592 29106 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:49.784090 29093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:49.777812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:35811 (local address 127.0.0.1:45355)
0808 07:09:49.778014 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:49.778025 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:49.778061 (+ 36us) server_negotiation.cc:407] Connection header received
0808 07:09:49.778481 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:49.778490 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:49.778563 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:49.778731 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:49.778990 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:49.780662 (+ 1672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:49.781796 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:49.782401 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:49.782506 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:49.783407 (+ 901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:49.783411 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:49.783412 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:49.783614 (+ 202us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:49.783654 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:49.783669 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:49.783759 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:49.783853 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 07:09:49.783879 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":79,"threads_started":1}
I20260808 07:09:49.785175 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:49.793081 29093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:49.789501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:44625 (local address 127.0.0.1:45355)
0808 07:09:49.789545 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:49.789547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:49.789682 (+ 135us) server_negotiation.cc:407] Connection header received
0808 07:09:49.789742 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:49.789743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:49.789754 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:49.789808 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:49.789956 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:49.790687 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:49.791715 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:49.792020 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:49.792078 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:49.792811 (+ 733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:49.792813 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:49.792813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:49.792818 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:49.792836 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:49.792841 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:49.792902 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:49.792969 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 07:09:49.792983 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:09:49.794325 29106 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:49.794827 29106 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:49.798879 29106 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8942ee44fdc5476c829a0f4d313169ab: Generated new TSK 0
I20260808 07:09:49.799058 29106 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:49.803566 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 28989
W20260808 07:09:49.818985 28965 connection.cc:535] client connection to 127.0.0.1:45355 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45355): Connection reset by peer (error 104)
2026-08-08T07:09:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1428 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:49 dist-test-slave-rmhg krb5kdc[29129](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:49 dist-test-slave-rmhg krb5kdc[29129](info): set up 2 sockets
Aug 08 07:09:49 dist-test-slave-rmhg krb5kdc[29129](info): commencing operation
krb5kdc: starting...
W20260808 07:09:50.935765 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:51 dist-test-slave-rmhg krb5kdc[29129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:09:51.057933 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37049
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:51.141574 29144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:51.141783 29144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:51.141815 29144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:51.142988 29144 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:51.143033 29144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:51.143051 29144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:51.143067 29144 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:51.143082 29144 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:51.144647 29144 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37049
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:51.144904 29144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:51.145174 29144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:51.149935 29151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:51.149940 29150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:51.149940 29153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:51.150174 29144 server_base.cc:1034] running on GCE node
I20260808 07:09:51.150419 29144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:51.150719 29144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:51.151873 29144 hybrid_clock.cc:648] HybridClock initialized: now 1786172991151857 us; error 29 us; skew 500 ppm
Aug 08 07:09:51 dist-test-slave-rmhg krb5kdc[29129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172991, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:51.154347 29144 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:09:51.154803 29144 webserver.cc:460] Webserver started at http://127.0.0.1:43797/ using document root <none> and password file <none>
I20260808 07:09:51.155035 29144 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:51.155085 29144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:51.155215 29144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:51.156291 29144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "5d5de16592d84dacafcfda559653470e"
format_stamp: "Formatted at 2026-08-08 07:09:51 on dist-test-slave-rmhg"
server_key: "8721e7202d98588c0e7961b00d8ca9b8"
server_key_iv: "e1daa7dfc4581182ab0eaf95991d01b9"
server_key_version: "encryptionkey@0"
I20260808 07:09:51.156641 29144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "5d5de16592d84dacafcfda559653470e"
format_stamp: "Formatted at 2026-08-08 07:09:51 on dist-test-slave-rmhg"
server_key: "8721e7202d98588c0e7961b00d8ca9b8"
server_key_iv: "e1daa7dfc4581182ab0eaf95991d01b9"
server_key_version: "encryptionkey@0"
I20260808 07:09:51.157975 29144 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:09:51.158762 29168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:51.158965 29144 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:09:51.159063 29144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "5d5de16592d84dacafcfda559653470e"
format_stamp: "Formatted at 2026-08-08 07:09:51 on dist-test-slave-rmhg"
server_key: "8721e7202d98588c0e7961b00d8ca9b8"
server_key_iv: "e1daa7dfc4581182ab0eaf95991d01b9"
server_key_version: "encryptionkey@0"
I20260808 07:09:51.159124 29144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:51.162582 29144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:51.164628 29144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:51.164763 29144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:51.168629 29144 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37049
I20260808 07:09:51.168660 29240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37049 every 8 connection(s)
I20260808 07:09:51.168985 29144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:51.170077 29241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:51.172456 29241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e: Bootstrap starting.
I20260808 07:09:51.173056 29241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:51.173353 29241 log.cc:824] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:51.173751 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 29144
I20260808 07:09:51.173872 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:51.174057 30025 external_mini_cluster.cc:1428] Setting key ad0bcd0a07b272a624534b9a27a68392
I20260808 07:09:51.174189 29241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e: No bootstrap required, opened a new log
I20260808 07:09:51.176421 29241 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d5de16592d84dacafcfda559653470e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37049 } }
I20260808 07:09:51.176609 29241 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:51.176676 29241 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5de16592d84dacafcfda559653470e, State: Initialized, Role: FOLLOWER
I20260808 07:09:51.176865 29241 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d5de16592d84dacafcfda559653470e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37049 } }
I20260808 07:09:51.176976 29241 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:51.176999 29241 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:51.177033 29241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:51.177107 29246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:51.174646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:38493 (local address 127.0.0.1:37049)
0808 07:09:51.174841 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:51.174852 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:51.174891 (+ 39us) server_negotiation.cc:407] Connection header received
0808 07:09:51.175557 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:51.175569 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:51.175608 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:51.175768 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:51.176369 (+ 601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:51.176373 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:51.176373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:51.176378 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:51.176427 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:51.176441 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:51.176517 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:51.176698 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 07:09:51.176748 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
I20260808 07:09:51.177793 29241 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d5de16592d84dacafcfda559653470e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37049 } }
I20260808 07:09:51.177904 29241 leader_election.cc:302] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d5de16592d84dacafcfda559653470e; no voters:
I20260808 07:09:51.178077 29241 leader_election.cc:288] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:51.178079 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:51.178118 29247 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:51.178316 29247 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [term 1 LEADER]: Becoming Leader. State: Replica: 5d5de16592d84dacafcfda559653470e, State: Running, Role: LEADER
I20260808 07:09:51.178339 29241 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:51.178442 29247 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d5de16592d84dacafcfda559653470e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37049 } }
I20260808 07:09:51.178881 29248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d5de16592d84dacafcfda559653470e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d5de16592d84dacafcfda559653470e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37049 } } }
I20260808 07:09:51.178966 29248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:51.179133 29249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d5de16592d84dacafcfda559653470e. Latest consensus state: current_term: 1 leader_uuid: "5d5de16592d84dacafcfda559653470e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d5de16592d84dacafcfda559653470e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37049 } } }
I20260808 07:09:51.179193 29249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e [sys.catalog]: This master's current role is: LEADER
W20260808 07:09:51.180395 29272 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:09:51.180457 29272 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:09:51.180506 29252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:51.180696 29252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:51.181409 29246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:51.180230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:34035 (local address 127.0.0.1:37049)
0808 07:09:51.180261 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:51.180263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:51.180383 (+ 120us) server_negotiation.cc:407] Connection header received
0808 07:09:51.180481 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:51.180482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:51.180487 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:51.180517 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:51.181188 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:51.181190 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:51.181190 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:51.181194 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:51.181208 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:51.181212 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:51.181239 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:51.181339 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 07:09:51.181352 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260808 07:09:51.182459 29252 catalog_manager.cc:1347] Generated new cluster ID: 5bc396acbd2f45078bed299d35977a81
I20260808 07:09:51.182509 29252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:51.194463 29252 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:51.194672 29252 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:51.201279 29252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d5de16592d84dacafcfda559653470e: Generated new TSK 0
I20260808 07:09:51.201476 29252 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:51.207115 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 29144
2026-08-08T07:09:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1400 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:51 dist-test-slave-rmhg krb5kdc[29280](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:51 dist-test-slave-rmhg krb5kdc[29280](info): set up 2 sockets
Aug 08 07:09:51 dist-test-slave-rmhg krb5kdc[29280](info): commencing operation
krb5kdc: starting...
W20260808 07:09:52.332759 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:52 dist-test-slave-rmhg krb5kdc[29280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:09:52.455581 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:35995
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:38335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:35995
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:52.538228 29296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:52.538444 29296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:52.538475 29296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:52.539637 29296 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:52.539682 29296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:52.539700 29296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:52.539716 29296 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:52.539731 29296 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:52.541275 29296 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:38335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:35995
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:35995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:52.541539 29296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:52.541779 29296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:52.546739 29303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:52.546747 29305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:52.546916 29296 server_base.cc:1034] running on GCE node
W20260808 07:09:52.546756 29307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:52.547284 29296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:52.547562 29296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:52.548719 29296 hybrid_clock.cc:648] HybridClock initialized: now 1786172992548697 us; error 38 us; skew 500 ppm
Aug 08 07:09:52 dist-test-slave-rmhg krb5kdc[29280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172992, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:52.554373 29296 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:09:52.554898 29296 webserver.cc:460] Webserver started at http://127.29.82.126:38545/ using document root <none> and password file <none>
I20260808 07:09:52.555114 29296 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:52.555156 29296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:52.555255 29296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:52.556298 29296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "c2ecfbbd03d5491faa3be0e464f3d4cf"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-rmhg"
server_key: "8022a22085e10cadd83812b0e2e85868"
server_key_iv: "d0600e8d8c0b0c3d0a9a864d354c53dd"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.556602 29296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "c2ecfbbd03d5491faa3be0e464f3d4cf"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-rmhg"
server_key: "8022a22085e10cadd83812b0e2e85868"
server_key_iv: "d0600e8d8c0b0c3d0a9a864d354c53dd"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.557940 29296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:52.558681 29317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:52.558840 29296 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:52.558933 29296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "c2ecfbbd03d5491faa3be0e464f3d4cf"
format_stamp: "Formatted at 2026-08-08 07:09:52 on dist-test-slave-rmhg"
server_key: "8022a22085e10cadd83812b0e2e85868"
server_key_iv: "d0600e8d8c0b0c3d0a9a864d354c53dd"
server_key_version: "encryptionkey@0"
I20260808 07:09:52.559005 29296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:52.575519 29296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:52.577688 29296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:52.577823 29296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:52.581890 29296 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:35995
I20260808 07:09:52.581931 29392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:35995 every 8 connection(s)
I20260808 07:09:52.582274 29296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:52.583191 29393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:52.585641 29393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf: Bootstrap starting.
I20260808 07:09:52.586283 29393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:52.586551 29393 log.cc:824] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:52.587313 29393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf: No bootstrap required, opened a new log
I20260808 07:09:52.589263 29393 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2ecfbbd03d5491faa3be0e464f3d4cf" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35995 } }
I20260808 07:09:52.589421 29393 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:52.589478 29393 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ecfbbd03d5491faa3be0e464f3d4cf, State: Initialized, Role: FOLLOWER
I20260808 07:09:52.589620 29393 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2ecfbbd03d5491faa3be0e464f3d4cf" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35995 } }
I20260808 07:09:52.589686 29393 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:52.589718 29393 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:52.589769 29393 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:52.590670 29393 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2ecfbbd03d5491faa3be0e464f3d4cf" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35995 } }
I20260808 07:09:52.590775 29393 leader_election.cc:302] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2ecfbbd03d5491faa3be0e464f3d4cf; no voters:
I20260808 07:09:52.590945 29393 leader_election.cc:288] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:52.590986 29400 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:52.591153 29400 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [term 1 LEADER]: Becoming Leader. State: Replica: c2ecfbbd03d5491faa3be0e464f3d4cf, State: Running, Role: LEADER
I20260808 07:09:52.591220 29393 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:52.591450 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 29296
I20260808 07:09:52.591549 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:52.591713 30025 external_mini_cluster.cc:1428] Setting key aa08880aafcb2687f212389ac8c27242
I20260808 07:09:52.591248 29400 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2ecfbbd03d5491faa3be0e464f3d4cf" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35995 } }
I20260808 07:09:52.592530 29402 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2ecfbbd03d5491faa3be0e464f3d4cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2ecfbbd03d5491faa3be0e464f3d4cf" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35995 } } }
I20260808 07:09:52.592629 29402 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:52.592550 29403 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2ecfbbd03d5491faa3be0e464f3d4cf. Latest consensus state: current_term: 1 leader_uuid: "c2ecfbbd03d5491faa3be0e464f3d4cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2ecfbbd03d5491faa3be0e464f3d4cf" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 35995 } } }
I20260808 07:09:52.593060 29403 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf [sys.catalog]: This master's current role is: LEADER
W20260808 07:09:52.593353 29420 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:09:52.593413 29420 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:09:52.593480 29423 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:52.593655 29423 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:52.595227 29423 catalog_manager.cc:1347] Generated new cluster ID: 1e98798c88a44f6badb5275916f22624
I20260808 07:09:52.595279 29423 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:09:52 dist-test-slave-rmhg krb5kdc[29280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:09:52.603618 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.592711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56403 (local address 127.29.82.126:35995)
0808 07:09:52.592863 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:52.592874 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:52.592947 (+ 73us) server_negotiation.cc:407] Connection header received
0808 07:09:52.593085 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:52.593092 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:52.593176 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:52.593324 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:52.593991 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.595264 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.596379 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.596982 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.597090 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.599907 (+ 2817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:52.599913 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:52.599913 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:52.599927 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:52.601869 (+ 1942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:52.602303 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:52.602306 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:52.602307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:52.602453 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:52.602660 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:52.602661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:52.602661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:52.602986 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:52.603155 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:52.603266 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 07:09:52.603376 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":72,"threads_started":1}
I20260808 07:09:52.604249 29423 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:52.604651 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:52.604843 29423 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:52.608777 29423 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2ecfbbd03d5491faa3be0e464f3d4cf: Generated new TSK 0
I20260808 07:09:52.608948 29423 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:52.615324 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:52.606193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40823 (local address 127.29.82.126:35995)
0808 07:09:52.606229 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:52.606231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:52.609077 (+ 2846us) server_negotiation.cc:407] Connection header received
0808 07:09:52.609140 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:52.609141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:52.609175 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:52.609234 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:52.609863 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.610368 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.611408 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:52.611605 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:52.611646 (+ 41us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:52.613005 (+ 1359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:52.613014 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:52.613015 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:52.613021 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:52.614275 (+ 1254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:52.614672 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:52.614673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:52.614673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:52.614724 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:52.614909 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:52.614909 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:52.614909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:52.615001 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:52.615078 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:52.615211 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 07:09:52.615261 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:09:52.617257 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 29296
W20260808 07:09:52.635485 29277 connection.cc:535] client connection to 127.29.82.126:35995 recv error: Network error: failed to read from TLS socket (remote: 127.29.82.126:35995): Connection reset by peer (error 104)
2026-08-08T07:09:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1415 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:52 dist-test-slave-rmhg krb5kdc[29436](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:52 dist-test-slave-rmhg krb5kdc[29436](info): set up 2 sockets
Aug 08 07:09:52 dist-test-slave-rmhg krb5kdc[29436](info): commencing operation
krb5kdc: starting...
W20260808 07:09:53.752588 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:53 dist-test-slave-rmhg krb5kdc[29436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:09:53.877311 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:39569
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:33511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:39569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:53.960952 29455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:53.961212 29455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:53.961248 29455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:53.962417 29455 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:53.962466 29455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:53.962483 29455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:53.962498 29455 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:53.962513 29455 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:53.964023 29455 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:33511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:39569
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:39569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:53.964272 29455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:53.964514 29455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:09:53.969364 29455 server_base.cc:1034] running on GCE node
W20260808 07:09:53.969341 29463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:53.969341 29461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:53.969326 29460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:53.969753 29455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:53.970045 29455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:53.971179 29455 hybrid_clock.cc:648] HybridClock initialized: now 1786172993971167 us; error 32 us; skew 500 ppm
Aug 08 07:09:53 dist-test-slave-rmhg krb5kdc[29436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172993, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:53.973690 29455 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:09:53.974164 29455 webserver.cc:460] Webserver started at http://127.29.82.126:33709/ using document root <none> and password file <none>
I20260808 07:09:53.974393 29455 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:53.974442 29455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:53.974547 29455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:53.975778 29455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "b75a156ab5f344968422f5bc7bc2b132"
format_stamp: "Formatted at 2026-08-08 07:09:53 on dist-test-slave-rmhg"
server_key: "31ac8fb12359bd739756adaaa44fdfc2"
server_key_iv: "0abc82f0421da66729efa3d5b8e000e1"
server_key_version: "encryptionkey@0"
I20260808 07:09:53.976248 29455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "b75a156ab5f344968422f5bc7bc2b132"
format_stamp: "Formatted at 2026-08-08 07:09:53 on dist-test-slave-rmhg"
server_key: "31ac8fb12359bd739756adaaa44fdfc2"
server_key_iv: "0abc82f0421da66729efa3d5b8e000e1"
server_key_version: "encryptionkey@0"
I20260808 07:09:53.977581 29455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:53.978257 29473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:53.978406 29455 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:53.978495 29455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "b75a156ab5f344968422f5bc7bc2b132"
format_stamp: "Formatted at 2026-08-08 07:09:53 on dist-test-slave-rmhg"
server_key: "31ac8fb12359bd739756adaaa44fdfc2"
server_key_iv: "0abc82f0421da66729efa3d5b8e000e1"
server_key_version: "encryptionkey@0"
I20260808 07:09:53.978556 29455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:53.997694 29455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:53.999825 29455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:53.999985 29455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:54.004091 29455 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:39569
I20260808 07:09:54.004135 29553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:39569 every 8 connection(s)
I20260808 07:09:54.004518 29455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:54.005483 29556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:54.007892 29556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132: Bootstrap starting.
I20260808 07:09:54.008473 29556 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:54.008751 29556 log.cc:824] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:54.009629 29556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132: No bootstrap required, opened a new log
I20260808 07:09:54.011238 29556 raft_consensus.cc:348] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b75a156ab5f344968422f5bc7bc2b132" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 39569 } }
I20260808 07:09:54.011384 29556 raft_consensus.cc:374] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:54.011406 29556 raft_consensus.cc:729] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b75a156ab5f344968422f5bc7bc2b132, State: Initialized, Role: FOLLOWER
I20260808 07:09:54.011567 29556 consensus_queue.cc:260] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b75a156ab5f344968422f5bc7bc2b132" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 39569 } }
I20260808 07:09:54.011633 29556 raft_consensus.cc:388] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:54.011655 29556 raft_consensus.cc:482] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:54.011703 29556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:54.012589 29556 raft_consensus.cc:504] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b75a156ab5f344968422f5bc7bc2b132" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 39569 } }
I20260808 07:09:54.012684 29556 leader_election.cc:302] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b75a156ab5f344968422f5bc7bc2b132; no voters:
I20260808 07:09:54.012844 29556 leader_election.cc:288] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:54.012898 29561 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:54.013106 29561 raft_consensus.cc:686] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [term 1 LEADER]: Becoming Leader. State: Replica: b75a156ab5f344968422f5bc7bc2b132, State: Running, Role: LEADER
I20260808 07:09:54.013106 29556 sys_catalog.cc:564] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:54.013260 29561 consensus_queue.cc:237] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b75a156ab5f344968422f5bc7bc2b132" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 39569 } }
I20260808 07:09:54.013507 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 29455
I20260808 07:09:54.013633 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:54.013690 29564 sys_catalog.cc:455] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b75a156ab5f344968422f5bc7bc2b132. Latest consensus state: current_term: 1 leader_uuid: "b75a156ab5f344968422f5bc7bc2b132" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b75a156ab5f344968422f5bc7bc2b132" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 39569 } } }
I20260808 07:09:54.013787 29564 sys_catalog.cc:458] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:54.013842 30025 external_mini_cluster.cc:1428] Setting key 1b86a59b09739759bd7c87808e65f5e8
I20260808 07:09:54.013995 29572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:54.014132 29562 sys_catalog.cc:455] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b75a156ab5f344968422f5bc7bc2b132" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b75a156ab5f344968422f5bc7bc2b132" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 39569 } } }
I20260808 07:09:54.014205 29562 sys_catalog.cc:458] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:54.014596 29572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:54.016284 29572 catalog_manager.cc:1347] Generated new cluster ID: a02312cb8a16433ba4caae83f5926b2e
I20260808 07:09:54.016335 29572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:54.020408 29585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:54.014505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48429 (local address 127.29.82.126:39569)
0808 07:09:54.015119 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:54.015129 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:54.015163 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:09:54.015286 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:54.015293 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:54.015355 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:54.015499 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:54.015781 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:54.017187 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:54.018281 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:54.018926 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:54.019043 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:54.019681 (+ 638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:54.019685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:54.019685 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:54.019910 (+ 225us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:54.019951 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:54.019967 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:54.020054 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:54.020156 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 07:09:54.020187 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":70,"threads_started":1}
I20260808 07:09:54.021837 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:54.036885 29585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:54.025531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53815 (local address 127.29.82.126:39569)
0808 07:09:54.025569 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:54.025571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:54.033359 (+ 7788us) server_negotiation.cc:407] Connection header received
0808 07:09:54.033425 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:54.033426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:54.033438 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:54.033488 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:54.033708 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:54.034458 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:54.035500 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:54.035818 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:54.035872 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:54.036632 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:54.036634 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:54.036634 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:54.036639 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:54.036657 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:54.036662 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:54.036707 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:54.036777 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 07:09:54.036793 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:09:54.041996 29572 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:54.042520 29572 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:54.047509 29572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b75a156ab5f344968422f5bc7bc2b132: Generated new TSK 0
I20260808 07:09:54.047726 29572 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:54.055239 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 29455
W20260808 07:09:54.071818 29433 connection.cc:535] client connection to 127.29.82.126:39569 recv error: Network error: failed to read from TLS socket (remote: 127.29.82.126:39569): Connection reset by peer (error 104)
2026-08-08T07:09:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1436 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:54 dist-test-slave-rmhg krb5kdc[29600](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:54 dist-test-slave-rmhg krb5kdc[29600](info): set up 2 sockets
Aug 08 07:09:54 dist-test-slave-rmhg krb5kdc[29600](info): commencing operation
krb5kdc: starting...
W20260808 07:09:55.187247 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:55 dist-test-slave-rmhg krb5kdc[29600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172995, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:09:55.311501 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:43775
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:38503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:43775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:55.395102 29615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:55.395327 29615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:55.395360 29615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:55.396538 29615 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:55.396584 29615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:55.396601 29615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:55.396618 29615 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:55.396633 29615 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:55.398219 29615 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:38503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:43775
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:43775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29615
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:55.398483 29615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:55.398707 29615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:55.403642 29620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:55.403648 29626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:55.403649 29622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:55.404018 29615 server_base.cc:1034] running on GCE node
I20260808 07:09:55.404282 29615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:55.404592 29615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:55.405752 29615 hybrid_clock.cc:648] HybridClock initialized: now 1786172995405732 us; error 35 us; skew 500 ppm
Aug 08 07:09:55 dist-test-slave-rmhg krb5kdc[29600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172995, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:55.408425 29615 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:09:55.408921 29615 webserver.cc:460] Webserver started at http://127.29.82.126:36371/ using document root <none> and password file <none>
I20260808 07:09:55.409189 29615 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:55.409252 29615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:55.409387 29615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:55.410460 29615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "e54ef1f4ca6b4db0b808ebe2c299d905"
format_stamp: "Formatted at 2026-08-08 07:09:55 on dist-test-slave-rmhg"
server_key: "ca6109b9f257b79da480e0b1f0f549ce"
server_key_iv: "72c7adb0aa4858e81d3f7c325ae17778"
server_key_version: "encryptionkey@0"
I20260808 07:09:55.410804 29615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "e54ef1f4ca6b4db0b808ebe2c299d905"
format_stamp: "Formatted at 2026-08-08 07:09:55 on dist-test-slave-rmhg"
server_key: "ca6109b9f257b79da480e0b1f0f549ce"
server_key_iv: "72c7adb0aa4858e81d3f7c325ae17778"
server_key_version: "encryptionkey@0"
I20260808 07:09:55.412151 29615 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:55.412873 29637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:55.413041 29615 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:55.413168 29615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "e54ef1f4ca6b4db0b808ebe2c299d905"
format_stamp: "Formatted at 2026-08-08 07:09:55 on dist-test-slave-rmhg"
server_key: "ca6109b9f257b79da480e0b1f0f549ce"
server_key_iv: "72c7adb0aa4858e81d3f7c325ae17778"
server_key_version: "encryptionkey@0"
I20260808 07:09:55.413245 29615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:55.417008 29615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:55.418990 29615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:55.419140 29615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:55.423167 29615 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:43775
I20260808 07:09:55.423247 29715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:43775 every 8 connection(s)
I20260808 07:09:55.423552 29615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:55.424580 29719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:55.426982 29719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905: Bootstrap starting.
I20260808 07:09:55.427258 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 29615
I20260808 07:09:55.427369 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:55.427526 30025 external_mini_cluster.cc:1428] Setting key e04b2393d87d9db78eaaca9bdadf63e4
I20260808 07:09:55.427603 29719 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:55.427927 29719 log.cc:824] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:55.428679 29719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905: No bootstrap required, opened a new log
I20260808 07:09:55.429993 29724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:55.428051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43181 (local address 127.29.82.126:43775)
0808 07:09:55.428226 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:55.428236 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:55.428271 (+ 35us) server_negotiation.cc:407] Connection header received
0808 07:09:55.428748 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:55.428755 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:55.428790 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:55.428928 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:55.429580 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:55.429584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:55.429584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:55.429588 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:55.429626 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:55.429637 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:55.429691 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:55.429769 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 07:09:55.429803 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":98,"threads_started":1}
I20260808 07:09:55.430914 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:55.431056 29719 raft_consensus.cc:348] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54ef1f4ca6b4db0b808ebe2c299d905" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43775 } }
I20260808 07:09:55.431205 29719 raft_consensus.cc:374] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:55.431248 29719 raft_consensus.cc:729] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54ef1f4ca6b4db0b808ebe2c299d905, State: Initialized, Role: FOLLOWER
I20260808 07:09:55.431366 29719 consensus_queue.cc:260] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54ef1f4ca6b4db0b808ebe2c299d905" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43775 } }
I20260808 07:09:55.431450 29719 raft_consensus.cc:388] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:55.431475 29719 raft_consensus.cc:482] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:55.431524 29719 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:55.432153 29719 raft_consensus.cc:504] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54ef1f4ca6b4db0b808ebe2c299d905" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43775 } }
I20260808 07:09:55.432257 29719 leader_election.cc:302] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e54ef1f4ca6b4db0b808ebe2c299d905; no voters:
I20260808 07:09:55.432421 29719 leader_election.cc:288] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:55.432464 29731 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:55.432682 29719 sys_catalog.cc:564] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:55.432687 29731 raft_consensus.cc:686] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [term 1 LEADER]: Becoming Leader. State: Replica: e54ef1f4ca6b4db0b808ebe2c299d905, State: Running, Role: LEADER
I20260808 07:09:55.432898 29731 consensus_queue.cc:237] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54ef1f4ca6b4db0b808ebe2c299d905" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43775 } }
I20260808 07:09:55.433321 29732 sys_catalog.cc:455] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e54ef1f4ca6b4db0b808ebe2c299d905" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54ef1f4ca6b4db0b808ebe2c299d905" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43775 } } }
I20260808 07:09:55.433408 29732 sys_catalog.cc:458] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:55.433619 29733 sys_catalog.cc:455] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e54ef1f4ca6b4db0b808ebe2c299d905. Latest consensus state: current_term: 1 leader_uuid: "e54ef1f4ca6b4db0b808ebe2c299d905" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54ef1f4ca6b4db0b808ebe2c299d905" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 43775 } } }
I20260808 07:09:55.433777 29724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:55.432322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44429 (local address 127.29.82.126:43775)
0808 07:09:55.432385 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:55.432387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:55.432515 (+ 128us) server_negotiation.cc:407] Connection header received
0808 07:09:55.432610 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:55.432610 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:55.432616 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:55.432685 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:55.433499 (+ 814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:55.433501 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:55.433501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:55.433517 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:55.433533 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:55.433538 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:55.433582 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:55.433706 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 07:09:55.433717 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 07:09:55.433965 29733 sys_catalog.cc:458] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905 [sys.catalog]: This master's current role is: LEADER
W20260808 07:09:55.434662 29755 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:09:55.434705 29755 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:09:55.434769 29741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:55.434985 29741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:55.436504 29741 catalog_manager.cc:1347] Generated new cluster ID: 4c357d1495a74f29b0903bb903215566
I20260808 07:09:55.436554 29741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:55.448262 29741 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:55.448505 29741 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:55.462556 29741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e54ef1f4ca6b4db0b808ebe2c299d905: Generated new TSK 0
I20260808 07:09:55.462787 29741 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:55.474026 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 29615
2026-08-08T07:09:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1413 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:55 dist-test-slave-rmhg krb5kdc[29762](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:55 dist-test-slave-rmhg krb5kdc[29762](info): set up 2 sockets
Aug 08 07:09:55 dist-test-slave-rmhg krb5kdc[29762](info): commencing operation
krb5kdc: starting...
W20260808 07:09:56.593417 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:56 dist-test-slave-rmhg krb5kdc[29762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:09:56.717295 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:38303
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:40005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:38303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:56.804839 29777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:56.805060 29777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:56.805090 29777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:56.806268 29777 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:56.806315 29777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:56.806334 29777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:56.806351 29777 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:56.806366 29777 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:56.807915 29777 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:40005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:38303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:38303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:56.808169 29777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:56.808379 29777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:56.813194 29786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:56.813201 29788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:56.813207 29783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:56.813495 29777 server_base.cc:1034] running on GCE node
I20260808 07:09:56.813726 29777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:56.814013 29777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:56.815177 29777 hybrid_clock.cc:648] HybridClock initialized: now 1786172996815159 us; error 31 us; skew 500 ppm
Aug 08 07:09:56 dist-test-slave-rmhg krb5kdc[29762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172996, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:56.817801 29777 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:09:56.818269 29777 webserver.cc:460] Webserver started at http://127.29.82.126:45441/ using document root <none> and password file <none>
I20260808 07:09:56.818496 29777 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:56.818543 29777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:56.818652 29777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:56.819710 29777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "557b838f353245e1858ae5079a1f796b"
format_stamp: "Formatted at 2026-08-08 07:09:56 on dist-test-slave-rmhg"
server_key: "735ccd7bc7aff4619ca6dbe8f8358522"
server_key_iv: "45c82290ebed5f1f151febf5f25d7e36"
server_key_version: "encryptionkey@0"
I20260808 07:09:56.820046 29777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "557b838f353245e1858ae5079a1f796b"
format_stamp: "Formatted at 2026-08-08 07:09:56 on dist-test-slave-rmhg"
server_key: "735ccd7bc7aff4619ca6dbe8f8358522"
server_key_iv: "45c82290ebed5f1f151febf5f25d7e36"
server_key_version: "encryptionkey@0"
I20260808 07:09:56.821391 29777 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:09:56.822114 29799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:56.822286 29777 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:56.822381 29777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "557b838f353245e1858ae5079a1f796b"
format_stamp: "Formatted at 2026-08-08 07:09:56 on dist-test-slave-rmhg"
server_key: "735ccd7bc7aff4619ca6dbe8f8358522"
server_key_iv: "45c82290ebed5f1f151febf5f25d7e36"
server_key_version: "encryptionkey@0"
I20260808 07:09:56.822441 29777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:56.840616 29777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:56.842953 29777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:56.843083 29777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:56.847075 29777 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:38303
I20260808 07:09:56.847138 29863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:38303 every 8 connection(s)
I20260808 07:09:56.847481 29777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:56.848407 29864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:56.850893 29864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b: Bootstrap starting.
I20260808 07:09:56.851528 29864 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:56.851800 29864 log.cc:824] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:56.852530 29864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b: No bootstrap required, opened a new log
I20260808 07:09:56.853041 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 29777
I20260808 07:09:56.853183 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:56.853375 30025 external_mini_cluster.cc:1428] Setting key 5976e751ed85de4bb68cf1c2d21faf08
I20260808 07:09:56.854636 29864 raft_consensus.cc:348] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "557b838f353245e1858ae5079a1f796b" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38303 } }
I20260808 07:09:56.854776 29864 raft_consensus.cc:374] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:56.854805 29864 raft_consensus.cc:729] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557b838f353245e1858ae5079a1f796b, State: Initialized, Role: FOLLOWER
I20260808 07:09:56.854957 29864 consensus_queue.cc:260] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "557b838f353245e1858ae5079a1f796b" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38303 } }
I20260808 07:09:56.855047 29864 raft_consensus.cc:388] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:56.855098 29864 raft_consensus.cc:482] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:56.855151 29864 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:56.856161 29864 raft_consensus.cc:504] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "557b838f353245e1858ae5079a1f796b" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38303 } }
I20260808 07:09:56.856261 29864 leader_election.cc:302] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 557b838f353245e1858ae5079a1f796b; no voters:
I20260808 07:09:56.856419 29864 leader_election.cc:288] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:56.856455 29870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:56.856616 29870 raft_consensus.cc:686] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [term 1 LEADER]: Becoming Leader. State: Replica: 557b838f353245e1858ae5079a1f796b, State: Running, Role: LEADER
I20260808 07:09:56.856707 29864 sys_catalog.cc:564] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:56.856766 29870 consensus_queue.cc:237] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "557b838f353245e1858ae5079a1f796b" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38303 } }
I20260808 07:09:56.857187 29870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 557b838f353245e1858ae5079a1f796b. Latest consensus state: current_term: 1 leader_uuid: "557b838f353245e1858ae5079a1f796b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "557b838f353245e1858ae5079a1f796b" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38303 } } }
I20260808 07:09:56.857270 29870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:56.857235 29873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "557b838f353245e1858ae5079a1f796b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "557b838f353245e1858ae5079a1f796b" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38303 } } }
I20260808 07:09:56.857321 29873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:56.857473 29881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:56.858009 29881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:56.859714 29881 catalog_manager.cc:1347] Generated new cluster ID: a837cede674c4f84b160aaea359a4d97
I20260808 07:09:56.859766 29881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:09:56 dist-test-slave-rmhg krb5kdc[29762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:09:56.864084 29869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:56.853904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45259 (local address 127.29.82.126:38303)
0808 07:09:56.854083 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:56.854091 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:56.854118 (+ 27us) server_negotiation.cc:407] Connection header received
0808 07:09:56.854626 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:56.854635 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:56.854695 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:56.854853 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:56.855616 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:56.856732 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:56.857814 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:56.858459 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:56.858605 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:56.860974 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:56.860979 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:56.860979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:56.860992 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:56.862582 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:56.862917 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:56.862920 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:56.862921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:56.863031 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:56.863211 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:56.863212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:56.863212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:56.863450 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:56.863608 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:56.863677 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 07:09:56.863918 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":82,"threads_started":1}
I20260808 07:09:56.865229 29881 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:56.865258 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:56.865911 29881 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:56.868834 29881 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 557b838f353245e1858ae5079a1f796b: Generated new TSK 0
I20260808 07:09:56.869011 29881 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:56.872710 29869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:56.866676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56373 (local address 127.29.82.126:38303)
0808 07:09:56.866711 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:56.866713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:56.866735 (+ 22us) server_negotiation.cc:407] Connection header received
0808 07:09:56.866804 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:56.866805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:56.866815 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:56.866859 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:56.867337 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:56.867822 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:56.868589 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:56.868931 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:56.869003 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:56.870382 (+ 1379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:56.870383 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:56.870384 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:09:56.870391 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:56.871719 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:56.872081 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:56.872082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:56.872082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:56.872137 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:09:56.872309 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:09:56.872310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:09:56.872310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:09:56.872401 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:56.872465 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:56.872581 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 07:09:56.872647 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:09:56.874660 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 29777
2026-08-08T07:09:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1421 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:56 dist-test-slave-rmhg krb5kdc[29910](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:56 dist-test-slave-rmhg krb5kdc[29910](info): set up 2 sockets
Aug 08 07:09:56 dist-test-slave-rmhg krb5kdc[29910](info): commencing operation
krb5kdc: starting...
W20260808 07:09:58.023483 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:58 dist-test-slave-rmhg krb5kdc[29910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172998, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:09:58.143735 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:41683
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:45715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:41683
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:58.227201 29933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:58.227411 29933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:58.227432 29933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:58.228593 29933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:58.228648 29933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:58.228667 29933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:58.228684 29933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:58.228698 29933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:58.230238 29933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:45715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:41683
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:41683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:58.230486 29933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:58.230702 29933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:58.235446 29941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:58.235472 29944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:58.235461 29939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:58.235716 29933 server_base.cc:1034] running on GCE node
I20260808 07:09:58.235955 29933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:58.236236 29933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:58.237385 29933 hybrid_clock.cc:648] HybridClock initialized: now 1786172998237374 us; error 32 us; skew 500 ppm
Aug 08 07:09:58 dist-test-slave-rmhg krb5kdc[29910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172998, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:58.243430 29933 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:09:58.243933 29933 webserver.cc:460] Webserver started at http://127.29.82.126:34289/ using document root <none> and password file <none>
I20260808 07:09:58.244150 29933 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:58.244201 29933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:58.244333 29933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:58.245556 29933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "eea6d375d7ee476a97337dbe82edf2d8"
format_stamp: "Formatted at 2026-08-08 07:09:58 on dist-test-slave-rmhg"
server_key: "e222b520a7c586848f1db0daf841ace1"
server_key_iv: "b74ef856a52e51c9e49679c48116847d"
server_key_version: "encryptionkey@0"
I20260808 07:09:58.245896 29933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "eea6d375d7ee476a97337dbe82edf2d8"
format_stamp: "Formatted at 2026-08-08 07:09:58 on dist-test-slave-rmhg"
server_key: "e222b520a7c586848f1db0daf841ace1"
server_key_iv: "b74ef856a52e51c9e49679c48116847d"
server_key_version: "encryptionkey@0"
I20260808 07:09:58.247200 29933 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:09:58.247922 29951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:58.248072 29933 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:58.248164 29933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "eea6d375d7ee476a97337dbe82edf2d8"
format_stamp: "Formatted at 2026-08-08 07:09:58 on dist-test-slave-rmhg"
server_key: "e222b520a7c586848f1db0daf841ace1"
server_key_iv: "b74ef856a52e51c9e49679c48116847d"
server_key_version: "encryptionkey@0"
I20260808 07:09:58.248224 29933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:58.262102 29933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:58.264230 29933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:58.264387 29933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:58.268371 29933 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:41683
I20260808 07:09:58.268419 30034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:41683 every 8 connection(s)
I20260808 07:09:58.268767 29933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:58.269305 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 29933
I20260808 07:09:58.269408 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:58.269580 30025 external_mini_cluster.cc:1428] Setting key c8089f0a8defacaea5379af0d26b86cb
I20260808 07:09:58.269685 30035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:58.272918 30035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8: Bootstrap starting.
I20260808 07:09:58.273604 30035 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:58.273933 30035 log.cc:824] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:58.274701 30035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8: No bootstrap required, opened a new log
I20260808 07:09:58.275142 30040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:58.270107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53221 (local address 127.29.82.126:41683)
0808 07:09:58.270294 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:58.270304 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:58.270328 (+ 24us) server_negotiation.cc:407] Connection header received
0808 07:09:58.270817 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:58.270824 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:58.270876 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:58.270996 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:58.271235 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:58.272124 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:58.273241 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:58.273681 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:58.273785 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:58.274463 (+ 678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:58.274467 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:58.274468 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:58.274633 (+ 165us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:58.274664 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:58.274675 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:58.274725 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:58.274864 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 07:09:58.274923 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":69,"threads_started":1}
I20260808 07:09:58.276289 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:58.276342 30035 raft_consensus.cc:348] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eea6d375d7ee476a97337dbe82edf2d8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41683 } }
I20260808 07:09:58.276501 30035 raft_consensus.cc:374] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:58.276538 30035 raft_consensus.cc:729] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eea6d375d7ee476a97337dbe82edf2d8, State: Initialized, Role: FOLLOWER
I20260808 07:09:58.276659 30035 consensus_queue.cc:260] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eea6d375d7ee476a97337dbe82edf2d8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41683 } }
I20260808 07:09:58.276718 30035 raft_consensus.cc:388] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:58.276739 30035 raft_consensus.cc:482] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:58.276783 30035 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:58.277402 30035 raft_consensus.cc:504] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eea6d375d7ee476a97337dbe82edf2d8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41683 } }
I20260808 07:09:58.277498 30035 leader_election.cc:302] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eea6d375d7ee476a97337dbe82edf2d8; no voters:
I20260808 07:09:58.277657 30035 leader_election.cc:288] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:58.277698 30049 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:58.277917 30035 sys_catalog.cc:564] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:58.277938 30049 raft_consensus.cc:686] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [term 1 LEADER]: Becoming Leader. State: Replica: eea6d375d7ee476a97337dbe82edf2d8, State: Running, Role: LEADER
I20260808 07:09:58.278121 30049 consensus_queue.cc:237] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eea6d375d7ee476a97337dbe82edf2d8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41683 } }
I20260808 07:09:58.278441 30049 sys_catalog.cc:455] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eea6d375d7ee476a97337dbe82edf2d8. Latest consensus state: current_term: 1 leader_uuid: "eea6d375d7ee476a97337dbe82edf2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eea6d375d7ee476a97337dbe82edf2d8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41683 } } }
I20260808 07:09:58.278745 30049 sys_catalog.cc:458] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:58.278673 30054 sys_catalog.cc:455] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eea6d375d7ee476a97337dbe82edf2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eea6d375d7ee476a97337dbe82edf2d8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 41683 } } }
I20260808 07:09:58.279148 30054 sys_catalog.cc:458] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:58.279161 30065 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:58.279958 30065 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:58.280987 30040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:58.277815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35207 (local address 127.29.82.126:41683)
0808 07:09:58.277849 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:58.277851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:58.277860 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:09:58.277940 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:58.277941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:58.277953 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:58.277981 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:58.278181 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:58.278894 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:58.279839 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:09:58.280068 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:09:58.280130 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:09:58.280727 (+ 597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:58.280728 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:58.280728 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:58.280733 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:58.280746 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:58.280751 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:58.280796 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:58.280892 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 07:09:58.280918 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:09:58.281829 30065 catalog_manager.cc:1347] Generated new cluster ID: e31fd2394ce349139b28ebc220674fed
I20260808 07:09:58.281874 30065 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:58.293799 30065 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:58.294590 30065 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:58.319392 30065 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eea6d375d7ee476a97337dbe82edf2d8: Generated new TSK 0
I20260808 07:09:58.319643 30065 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:58.323115 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 29933
2026-08-08T07:09:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1427 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:58 dist-test-slave-rmhg krb5kdc[30084](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:58 dist-test-slave-rmhg krb5kdc[30084](info): set up 2 sockets
Aug 08 07:09:58 dist-test-slave-rmhg krb5kdc[30084](info): commencing operation
krb5kdc: starting...
W20260808 07:09:59.452670 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:09:59 dist-test-slave-rmhg krb5kdc[30084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:09:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:09:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:09:59.574034 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:45313
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:35401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:45313
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:09:59.659026 30110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:09:59.659248 30110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:09:59.659279 30110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:09:59.660430 30110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:09:59.660482 30110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:09:59.660501 30110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:09:59.660516 30110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:09:59.660532 30110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:09:59.662109 30110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:35401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:45313
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:45313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:09:59.662375 30110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:09:59.662616 30110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:09:59.667470 30117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:59.667572 30110 server_base.cc:1034] running on GCE node
W20260808 07:09:59.667439 30116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:09:59.667500 30119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:09:59.667860 30110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:09:59.668134 30110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:09:59.669240 30110 hybrid_clock.cc:648] HybridClock initialized: now 1786172999669222 us; error 29 us; skew 500 ppm
Aug 08 07:09:59 dist-test-slave-rmhg krb5kdc[30084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172999, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:09:59.671741 30110 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:09:59.672192 30110 webserver.cc:460] Webserver started at http://127.29.82.126:45749/ using document root <none> and password file <none>
I20260808 07:09:59.672402 30110 fs_manager.cc:359] Metadata directory not provided
I20260808 07:09:59.672451 30110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:09:59.672588 30110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:09:59.673697 30110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "6a15d657e57145d4bb95a223eb06efe8"
format_stamp: "Formatted at 2026-08-08 07:09:59 on dist-test-slave-rmhg"
server_key: "2e9876f3692e370549c563478bcb0f2d"
server_key_iv: "f12245a979a39e62b100de0f038bdc14"
server_key_version: "encryptionkey@0"
I20260808 07:09:59.674028 30110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "6a15d657e57145d4bb95a223eb06efe8"
format_stamp: "Formatted at 2026-08-08 07:09:59 on dist-test-slave-rmhg"
server_key: "2e9876f3692e370549c563478bcb0f2d"
server_key_iv: "f12245a979a39e62b100de0f038bdc14"
server_key_version: "encryptionkey@0"
I20260808 07:09:59.675329 30110 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:09:59.676084 30129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:09:59.676257 30110 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:09:59.676350 30110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "6a15d657e57145d4bb95a223eb06efe8"
format_stamp: "Formatted at 2026-08-08 07:09:59 on dist-test-slave-rmhg"
server_key: "2e9876f3692e370549c563478bcb0f2d"
server_key_iv: "f12245a979a39e62b100de0f038bdc14"
server_key_version: "encryptionkey@0"
I20260808 07:09:59.676411 30110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:09:59.679754 30110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:09:59.681618 30110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:09:59.681748 30110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:09:59.685590 30110 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:45313
I20260808 07:09:59.685618 30204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:45313 every 8 connection(s)
I20260808 07:09:59.685930 30110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:09:59.686893 30205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:09:59.689339 30205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8: Bootstrap starting.
I20260808 07:09:59.689644 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 30110
I20260808 07:09:59.689787 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:09:59.689973 30025 external_mini_cluster.cc:1428] Setting key 04b25cd943041d2f63ef496da1e12507
I20260808 07:09:59.690117 30205 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8: Neither blocks nor log segments found. Creating new log.
I20260808 07:09:59.690431 30205 log.cc:824] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8: Log is configured to *not* fsync() on all Append() calls
I20260808 07:09:59.691208 30205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8: No bootstrap required, opened a new log
I20260808 07:09:59.692533 30208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:59.690507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39865 (local address 127.29.82.126:45313)
0808 07:09:59.690705 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:59.690715 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:59.690750 (+ 35us) server_negotiation.cc:407] Connection header received
0808 07:09:59.691258 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:59.691266 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:59.691303 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:59.691448 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:59.692099 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:59.692103 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:59.692103 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:59.692107 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:59.692154 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:59.692165 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:59.692239 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:59.692309 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 07:09:59.692344 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":80,"threads_started":1}
I20260808 07:09:59.693470 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:09:59.693575 30205 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a15d657e57145d4bb95a223eb06efe8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45313 } }
I20260808 07:09:59.693735 30205 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:09:59.693771 30205 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a15d657e57145d4bb95a223eb06efe8, State: Initialized, Role: FOLLOWER
I20260808 07:09:59.693878 30205 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a15d657e57145d4bb95a223eb06efe8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45313 } }
I20260808 07:09:59.693961 30205 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:09:59.693997 30205 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:09:59.694042 30205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:09:59.694749 30205 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a15d657e57145d4bb95a223eb06efe8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45313 } }
I20260808 07:09:59.694864 30205 leader_election.cc:302] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a15d657e57145d4bb95a223eb06efe8; no voters:
I20260808 07:09:59.695031 30205 leader_election.cc:288] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:09:59.695052 30216 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:09:59.695232 30216 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [term 1 LEADER]: Becoming Leader. State: Replica: 6a15d657e57145d4bb95a223eb06efe8, State: Running, Role: LEADER
I20260808 07:09:59.695319 30216 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a15d657e57145d4bb95a223eb06efe8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45313 } }
I20260808 07:09:59.695361 30205 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:09:59.695703 30221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a15d657e57145d4bb95a223eb06efe8. Latest consensus state: current_term: 1 leader_uuid: "6a15d657e57145d4bb95a223eb06efe8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a15d657e57145d4bb95a223eb06efe8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45313 } } }
I20260808 07:09:59.695701 30220 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a15d657e57145d4bb95a223eb06efe8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a15d657e57145d4bb95a223eb06efe8" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45313 } } }
I20260808 07:09:59.695823 30221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:59.695830 30220 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8 [sys.catalog]: This master's current role is: LEADER
I20260808 07:09:59.696061 30229 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:09:59.696569 30229 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:09:59.697868 30208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:09:59.695027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53691 (local address 127.29.82.126:45313)
0808 07:09:59.695074 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:09:59.695076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:09:59.696827 (+ 1751us) server_negotiation.cc:407] Connection header received
0808 07:09:59.696929 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:09:59.696930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:09:59.696936 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:09:59.696983 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:09:59.697536 (+ 553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:09:59.697538 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:09:59.697538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:09:59.697542 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:09:59.697557 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:09:59.697561 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:09:59.697611 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 07:09:59.697813 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 07:09:59.697825 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:09:59.698390 30229 catalog_manager.cc:1347] Generated new cluster ID: 7e67b34f1543416e90ed4d8c62742a8e
I20260808 07:09:59.698427 30229 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:09:59.711172 30229 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:09:59.711372 30229 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:09:59.718077 30229 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a15d657e57145d4bb95a223eb06efe8: Generated new TSK 0
I20260808 07:09:59.718268 30229 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:09:59.722110 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 30110
2026-08-08T07:09:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1403 ms)
[----------] 18 tests from AuthTokenIssuingTest (25612 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:09:59 dist-test-slave-rmhg krb5kdc[30249](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:09:59 dist-test-slave-rmhg krb5kdc[30249](info): set up 2 sockets
Aug 08 07:09:59 dist-test-slave-rmhg krb5kdc[30249](info): commencing operation
krb5kdc: starting...
W20260808 07:10:00.847870 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:10:00 dist-test-slave-rmhg krb5kdc[30249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173000, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:10:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:10:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:10:00.971406 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:38781
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:44095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:38781,127.29.82.125:41735,127.29.82.124:38977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:10:01.053562 30268 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:10:01.053791 30268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:01.053813 30268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:01.053838 30268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:01.054997 30268 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:10:01.055042 30268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:01.055059 30268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:01.055074 30268 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:10:01.055089 30268 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:10:01.056636 30268 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:44095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:38781,127.29.82.125:41735,127.29.82.124:38977
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:38781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:10:01.056895 30268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:01.057129 30268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:01.062243 30277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:01.062254 30275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:01.062254 30279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:01.062611 30268 server_base.cc:1034] running on GCE node
I20260808 07:10:01.062830 30268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:01.063119 30268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:01.064291 30268 hybrid_clock.cc:648] HybridClock initialized: now 1786173001064273 us; error 31 us; skew 500 ppm
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173001, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:01.066922 30268 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:10:01.067410 30268 webserver.cc:460] Webserver started at http://127.29.82.126:42179/ using document root <none> and password file <none>
I20260808 07:10:01.067655 30268 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:01.067708 30268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:01.067824 30268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:10:01.068912 30268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33"
format_stamp: "Formatted at 2026-08-08 07:10:01 on dist-test-slave-rmhg"
server_key: "51a7fcb77a49fb2c212e6a3380cfaafc"
server_key_iv: "77591f052e8dda73cb8b4ed37234667a"
server_key_version: "encryptionkey@0"
I20260808 07:10:01.069278 30268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33"
format_stamp: "Formatted at 2026-08-08 07:10:01 on dist-test-slave-rmhg"
server_key: "51a7fcb77a49fb2c212e6a3380cfaafc"
server_key_iv: "77591f052e8dda73cb8b4ed37234667a"
server_key_version: "encryptionkey@0"
I20260808 07:10:01.070669 30268 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:10:01.071506 30288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:01.071725 30268 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:10:01.071827 30268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33"
format_stamp: "Formatted at 2026-08-08 07:10:01 on dist-test-slave-rmhg"
server_key: "51a7fcb77a49fb2c212e6a3380cfaafc"
server_key_iv: "77591f052e8dda73cb8b4ed37234667a"
server_key_version: "encryptionkey@0"
I20260808 07:10:01.071890 30268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:01.098058 30268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:01.100243 30268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:01.100399 30268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:01.104511 30268 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:38781
I20260808 07:10:01.104570 30371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:38781 every 8 connection(s)
I20260808 07:10:01.104921 30268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:10:01.105929 30372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:10:01.107389 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 30268
I20260808 07:10:01.107498 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:10:01.107669 30025 external_mini_cluster.cc:1428] Setting key 7b8dd69d5063d1060b044019aae580d6
I20260808 07:10:01.107659 30372 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173001, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.82.125@KRBTEST.COM; defaulting to no policy
I20260808 07:10:01.118709 30374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.108448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60342 (local address 127.29.82.126:38781)
0808 07:10:01.108652 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.108662 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.108802 (+ 140us) server_negotiation.cc:407] Connection header received
0808 07:10:01.109590 (+ 788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.109593 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.109619 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.109719 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.110255 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.111307 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.112599 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.112928 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.113016 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.115503 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.115510 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.115511 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.115518 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.117065 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.117454 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.117456 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.117457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.117572 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.117816 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.117817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.117817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.118037 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.118097 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.118339 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.118569 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":129,"server-negotiator.queue_time_us":148,"thread_start_us":105,"threads_started":1}
I20260808 07:10:01.118709 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.108479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38781 (local address 127.0.0.1:60342)
0808 07:10:01.108674 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.108715 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:01.109339 (+ 624us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:01.109733 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:01.109736 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:01.109992 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:01.110162 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.110166 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.111416 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.111417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.112481 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.112485 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.113037 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.113039 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.113122 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.113766 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:01.113777 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:01.115389 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:01.117142 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.117177 (+ 35us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.117180 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.117387 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.117654 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.117655 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.117655 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.117755 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.118105 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:01.118112 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:01.118180 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 07:10:01.118263 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 07:10:01.118446 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":100,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.125@KRBTEST.COM" created.
I20260808 07:10:01.119460 30372 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:10:01.119818 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.119686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:41735 (local address 127.0.0.1:59012)
0808 07:10:01.119731 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.119789 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:41735: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 07:10:01.119969 30296 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.82.125:41735: connect: Connection refused (error 111)
I20260808 07:10:01.120363 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.120277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:41735 (local address 127.0.0.1:59014)
0808 07:10:01.120315 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.120342 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:41735: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 07:10:01.120494 30372 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.125:41735: Network error: Client connection negotiation failed: client connection to 127.29.82.125:41735: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.125.keytab.
Entry for principal kudu/127.29.82.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.125.keytab.
I20260808 07:10:01.134019 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.125:41735
--webserver_interface=127.29.82.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.125.keytab
--principal=kudu/127.29.82.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:44095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:38781,127.29.82.125:41735,127.29.82.124:38977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:10:01.169742 30372 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } attempt: 1
I20260808 07:10:01.170260 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.170129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:41735 (local address 127.0.0.1:59026)
0808 07:10:01.170192 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.170227 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:41735: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 07:10:01.170591 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.170506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:41735 (local address 127.0.0.1:59038)
0808 07:10:01.170545 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.170571 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:41735: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 07:10:01.170673 30372 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.125:41735: Network error: Client connection negotiation failed: client connection to 127.29.82.125:41735: connect: Connection refused (error 111)
W20260808 07:10:01.217592 30381 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:10:01.217839 30381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:01.217865 30381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:01.217891 30381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:01.219075 30381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:10:01.219118 30381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:01.219137 30381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:01.219156 30381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:10:01.219169 30381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:10:01.220682 30381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:44095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:38781,127.29.82.125:41735,127.29.82.124:38977
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.125.keytab
--principal=kudu/127.29.82.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.125:41735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.82.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:10:01.220947 30381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:01.221194 30381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:01.226055 30389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:01.226058 30392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:01.226341 30381 server_base.cc:1034] running on GCE node
W20260808 07:10:01.226052 30388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:01.226655 30381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:01.226935 30381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:01.228083 30381 hybrid_clock.cc:648] HybridClock initialized: now 1786173001228070 us; error 29 us; skew 500 ppm
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173001, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:01.230494 30381 init.cc:377] Logged in from keytab as kudu/127.29.82.125@KRBTEST.COM (short username kudu)
I20260808 07:10:01.230944 30381 webserver.cc:460] Webserver started at http://127.29.82.125:34451/ using document root <none> and password file <none>
I20260808 07:10:01.231158 30381 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:01.231205 30381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:01.231341 30381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:10:01.232383 30381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/data/instance:
uuid: "4525beef1b38491bb450ba48b43171ec"
format_stamp: "Formatted at 2026-08-08 07:10:01 on dist-test-slave-rmhg"
server_key: "5f0e5b6d1369a72da3134ef4ef1ce3d6"
server_key_iv: "757dde071569d431bc14a07533bd9547"
server_key_version: "encryptionkey@0"
I20260808 07:10:01.232725 30381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/wal/instance:
uuid: "4525beef1b38491bb450ba48b43171ec"
format_stamp: "Formatted at 2026-08-08 07:10:01 on dist-test-slave-rmhg"
server_key: "5f0e5b6d1369a72da3134ef4ef1ce3d6"
server_key_iv: "757dde071569d431bc14a07533bd9547"
server_key_version: "encryptionkey@0"
I20260808 07:10:01.234069 30381 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 07:10:01.234768 30401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:01.234915 30381 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:10:01.235013 30381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/wal
uuid: "4525beef1b38491bb450ba48b43171ec"
format_stamp: "Formatted at 2026-08-08 07:10:01 on dist-test-slave-rmhg"
server_key: "5f0e5b6d1369a72da3134ef4ef1ce3d6"
server_key_iv: "757dde071569d431bc14a07533bd9547"
server_key_version: "encryptionkey@0"
I20260808 07:10:01.235086 30381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:01.238822 30372 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } attempt: 2
I20260808 07:10:01.239234 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.239091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:41735 (local address 127.0.0.1:59054)
0808 07:10:01.239151 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.239194 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:41735: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 07:10:01.239603 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.239538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:41735 (local address 127.0.0.1:59062)
0808 07:10:01.239568 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.239588 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:41735: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 07:10:01.239686 30372 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.125:41735: Network error: Client connection negotiation failed: client connection to 127.29.82.125:41735: connect: Connection refused (error 111)
I20260808 07:10:01.258285 30381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:01.260447 30381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:01.260574 30381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:01.264647 30381 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.125:41735
I20260808 07:10:01.264693 30477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.125:41735 every 8 connection(s)
I20260808 07:10:01.265035 30381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/data/info.pb
I20260808 07:10:01.266043 30479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:10:01.267565 30479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:10:01.269887 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 30381
I20260808 07:10:01.269966 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-1/wal/instance
I20260808 07:10:01.270105 30025 external_mini_cluster.cc:1428] Setting key 7524714739438d07893964dec536c9fc
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173001, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.125@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:10:01.276930 30374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.268296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60352 (local address 127.29.82.126:38781)
0808 07:10:01.268349 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.268350 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.268560 (+ 210us) server_negotiation.cc:407] Connection header received
0808 07:10:01.269030 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.269031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.269046 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.269098 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.269728 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.270310 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.271601 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.271811 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.271874 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.274090 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.274092 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.274092 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.274100 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.275551 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.275986 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.275987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.275988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.276047 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.276277 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.276278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.276278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.276399 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.276456 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.276746 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.276837 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:10:01.277115 30481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.268255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38781 (local address 127.0.0.1:60352)
0808 07:10:01.268439 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.268486 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:01.268928 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:01.269181 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:01.269185 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:01.269436 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:01.269640 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.269644 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.270397 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.270399 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.271526 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.271529 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.271927 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.271929 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.272050 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.272581 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:01.272591 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:01.273993 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:01.275634 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.275642 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.275645 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.275924 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.276104 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.276105 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.276105 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.276219 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.276455 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:01.276463 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:01.276620 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 07:10:01.276714 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 07:10:01.276877 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":109,"threads_started":1}
I20260808 07:10:01.277878 30479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.29.82.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.124@KRBTEST.COM" created.
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173001, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.125@KRBTEST.COM for kudu/127.29.82.125@KRBTEST.COM
I20260808 07:10:01.285588 30481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.278145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:41735 (local address 127.0.0.1:59074)
0808 07:10:01.278334 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.278345 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:01.278402 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:01.278532 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:01.278533 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:01.278680 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:01.278726 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.278728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.279649 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.279650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.280240 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.280242 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.280763 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.280764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.280850 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.281306 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:01.281312 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:01.282596 (+ 1284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:01.284379 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.284381 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.284381 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.284606 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.284830 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.284831 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.284831 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.284898 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.285201 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:01.285202 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:01.285255 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 07:10:01.285338 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 07:10:01.285459 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 07:10:01.285655 30486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.278206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59074 (local address 127.29.82.125:41735)
0808 07:10:01.278352 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.278357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.278392 (+ 35us) server_negotiation.cc:407] Connection header received
0808 07:10:01.278448 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.278450 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.278465 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.278564 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.278788 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.279569 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.280309 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.280692 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.280763 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.282679 (+ 1916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.282688 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.282688 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.282696 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.284278 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.284705 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.284708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.284708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.284769 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.284962 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.284963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.284963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.285113 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.285213 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.285378 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.285542 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":119,"thread_start_us":83,"threads_started":1}
I20260808 07:10:01.286592 30479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:10:01.286996 30481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.286860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:38977 (local address 127.0.0.1:37936)
0808 07:10:01.286907 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.286965 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 07:10:01.287163 30403 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
I20260808 07:10:01.287636 30481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.287534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:38977 (local address 127.0.0.1:37948)
0808 07:10:01.287583 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.287612 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 07:10:01.287792 30479 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:38977: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.124.keytab.
Entry for principal kudu/127.29.82.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.124.keytab.
I20260808 07:10:01.297355 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.124:38977
--webserver_interface=127.29.82.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.124.keytab
--principal=kudu/127.29.82.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:44095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:38781,127.29.82.125:41735,127.29.82.124:38977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:10:01.330879 30372 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } attempt: 3
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173001, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for kudu/127.29.82.125@KRBTEST.COM
I20260808 07:10:01.337019 30479 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } attempt: 1
I20260808 07:10:01.337466 30481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.337349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:38977 (local address 127.0.0.1:37960)
0808 07:10:01.337405 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.337434 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 07:10:01.337992 30481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.337905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:38977 (local address 127.0.0.1:37968)
0808 07:10:01.337943 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.337970 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 07:10:01.338155 30479 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:38977: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
I20260808 07:10:01.339515 30486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.331486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59080 (local address 127.29.82.125:41735)
0808 07:10:01.331558 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.331561 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.331571 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:10:01.331606 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.331607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.331622 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.331707 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.332146 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.332926 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.333813 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.334168 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.334259 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.336567 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.336569 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.336569 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.336581 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.338382 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.338785 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.338787 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.338787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.338841 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.339067 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.339067 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.339067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.339183 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.339229 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.339384 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.339458 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 07:10:01.339640 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.331353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:41735 (local address 127.0.0.1:59080)
0808 07:10:01.331428 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.331442 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:01.331498 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:01.331780 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:01.331781 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:01.331980 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:01.332058 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.332061 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.333053 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.333054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.333694 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.333698 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.334326 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.334327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.334411 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.334901 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:01.334906 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:01.336450 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:01.338467 (+ 2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.338469 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.338469 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.338648 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.338906 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.338907 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.338908 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.339001 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.339234 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:01.339235 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:01.339293 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 07:10:01.339367 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 07:10:01.339484 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 07:10:01.340035 30372 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:10:01.340370 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.340270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:38977 (local address 127.0.0.1:37978)
0808 07:10:01.340315 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.340348 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 07:10:01.340621 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.340558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:38977 (local address 127.0.0.1:37988)
0808 07:10:01.340582 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.340605 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260808 07:10:01.340708 30372 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:38977: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
I20260808 07:10:01.371869 30372 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } attempt: 1
I20260808 07:10:01.372395 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.372247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:38977 (local address 127.0.0.1:38002)
0808 07:10:01.372312 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.372359 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 07:10:01.372767 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.372677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:38977 (local address 127.0.0.1:38010)
0808 07:10:01.372718 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.372746 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 07:10:01.372851 30372 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:38977: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
W20260808 07:10:01.385260 30490 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:10:01.385483 30490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:01.385500 30490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:01.385520 30490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:01.386691 30490 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:10:01.386734 30490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:01.386746 30490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:01.386757 30490 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:10:01.386768 30490 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:10:01.388280 30490 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:44095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:38781,127.29.82.125:41735,127.29.82.124:38977
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.124.keytab
--principal=kudu/127.29.82.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.124:38977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.82.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:10:01.388531 30490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:01.388762 30490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:01.393513 30501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:01.393519 30498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:01.393586 30497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:01.393925 30490 server_base.cc:1034] running on GCE node
I20260808 07:10:01.394174 30490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:01.394433 30490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:01.395573 30490 hybrid_clock.cc:648] HybridClock initialized: now 1786173001395560 us; error 32 us; skew 500 ppm
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173001, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:01.397993 30490 init.cc:377] Logged in from keytab as kudu/127.29.82.124@KRBTEST.COM (short username kudu)
I20260808 07:10:01.398449 30490 webserver.cc:460] Webserver started at http://127.29.82.124:45465/ using document root <none> and password file <none>
I20260808 07:10:01.398660 30490 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:01.398699 30490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:01.398795 30490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:10:01.399796 30490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/data/instance:
uuid: "24d9a797f83146f7bcd5253708f7be29"
format_stamp: "Formatted at 2026-08-08 07:10:01 on dist-test-slave-rmhg"
server_key: "a7f7c5e9adb53d7b69518d980500a52f"
server_key_iv: "efdd84e413d94238cb7f7de6613a4f9d"
server_key_version: "encryptionkey@0"
I20260808 07:10:01.400100 30490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/wal/instance:
uuid: "24d9a797f83146f7bcd5253708f7be29"
format_stamp: "Formatted at 2026-08-08 07:10:01 on dist-test-slave-rmhg"
server_key: "a7f7c5e9adb53d7b69518d980500a52f"
server_key_iv: "efdd84e413d94238cb7f7de6613a4f9d"
server_key_version: "encryptionkey@0"
I20260808 07:10:01.401398 30490 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:10:01.402108 30514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:01.402320 30490 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:10:01.402420 30490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/wal
uuid: "24d9a797f83146f7bcd5253708f7be29"
format_stamp: "Formatted at 2026-08-08 07:10:01 on dist-test-slave-rmhg"
server_key: "a7f7c5e9adb53d7b69518d980500a52f"
server_key_iv: "efdd84e413d94238cb7f7de6613a4f9d"
server_key_version: "encryptionkey@0"
I20260808 07:10:01.402500 30490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:01.406297 30479 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } attempt: 2
I20260808 07:10:01.406744 30481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.406616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:38977 (local address 127.0.0.1:38014)
0808 07:10:01.406674 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.406715 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 07:10:01.407033 30481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.406953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:38977 (local address 127.0.0.1:38028)
0808 07:10:01.406986 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.407008 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 07:10:01.407116 30479 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:38977: Network error: Client connection negotiation failed: client connection to 127.29.82.124:38977: connect: Connection refused (error 111)
I20260808 07:10:01.414443 30490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:01.416352 30490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:01.416477 30490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:01.420347 30490 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.124:38977
I20260808 07:10:01.420393 30596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.124:38977 every 8 connection(s)
I20260808 07:10:01.420743 30490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/data/info.pb
I20260808 07:10:01.421826 30597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:10:01.423329 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 30490
I20260808 07:10:01.423413 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172701750152-30025-0/minicluster-data/master-2/wal/instance
I20260808 07:10:01.423573 30025 external_mini_cluster.cc:1428] Setting key 8dddefc3879f1751437ba7b22f2a8f05
I20260808 07:10:01.423513 30597 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173001, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.124@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173000, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.124@KRBTEST.COM
I20260808 07:10:01.432983 30374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.424342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60358 (local address 127.29.82.126:38781)
0808 07:10:01.424444 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.424447 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.424558 (+ 111us) server_negotiation.cc:407] Connection header received
0808 07:10:01.424973 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.424975 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.424997 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.425066 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.425687 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.426165 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.427153 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.427428 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.427484 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.429924 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.429926 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.429926 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.429934 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.431397 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.431849 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.431851 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.431852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.431920 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.432207 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.432208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.432209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.432361 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.432421 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.432775 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.432872 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 07:10:01.433185 30602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.424216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:38781 (local address 127.0.0.1:60358)
0808 07:10:01.424414 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.424468 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:01.424844 (+ 376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:01.425090 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:01.425092 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:01.425411 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:01.425593 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.425598 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.426236 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.426238 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.427079 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.427082 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.427557 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.427558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.427695 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.428260 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:01.428268 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:01.429833 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:01.431466 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.431480 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.431482 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.431756 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.431991 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.431991 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.431991 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.432127 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.432422 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:01.432429 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:01.432629 (+ 200us) client_negotiation.cc:769] Sending connection context
0808 07:10:01.432748 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 07:10:01.432920 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":79,"threads_started":1}
I20260808 07:10:01.433285 30601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.424110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38034 (local address 127.29.82.124:38977)
0808 07:10:01.424280 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.424290 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.424326 (+ 36us) server_negotiation.cc:407] Connection header received
0808 07:10:01.424833 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.424842 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.424869 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.424959 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.425639 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.426597 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.427408 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.427799 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.427872 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.430355 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.430364 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.430364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.430371 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.431987 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.432323 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.432326 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.432326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.432373 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.432593 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.432594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.432594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.432749 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.432875 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.432989 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.433060 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260808 07:10:01.434048 30597 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173001, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.124@KRBTEST.COM for kudu/127.29.82.125@KRBTEST.COM
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173000, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:10:01.440629 30602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.434294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:41735 (local address 127.0.0.1:59084)
0808 07:10:01.434331 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.434339 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:01.434367 (+ 28us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:01.434534 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:01.434535 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:01.434654 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:01.434699 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.434700 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.435339 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.435341 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.435863 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.435865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.436213 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.436214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.436279 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.436761 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:01.436766 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:01.437958 (+ 1192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:01.439708 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.439709 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.439709 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.439871 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.440048 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.440048 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.440049 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.440104 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.440317 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:01.440319 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:01.440364 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 07:10:01.440423 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 07:10:01.440529 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 07:10:01.440629 30486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.434372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59084 (local address 127.29.82.125:41735)
0808 07:10:01.434424 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.434426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.434434 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:10:01.434458 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.434459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.434468 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.434525 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.434763 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.435262 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.435950 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.436147 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.436206 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.438037 (+ 1831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.438038 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.438039 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.438046 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.439622 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.439937 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.439939 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.439939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.439995 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.440151 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.440153 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.440153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.440265 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.440319 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.440453 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.440530 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:10:01.440987 30374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.434140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60374 (local address 127.29.82.126:38781)
0808 07:10:01.434178 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.434179 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.434189 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:10:01.434258 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.434259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.434267 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.434319 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.434831 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.435284 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.435922 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.436132 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.436181 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.438644 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.438645 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.438645 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.438652 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.440009 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.440305 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.440306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.440307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.440357 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.440518 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.440519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.440519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.440624 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.440797 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.440831 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.440899 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:10:01.441463 30597 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173001, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.124@KRBTEST.COM for kudu/127.29.82.124@KRBTEST.COM
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173000, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.125@KRBTEST.COM
I20260808 07:10:01.447983 30372 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } attempt: 2
I20260808 07:10:01.448100 30602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.441731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:38977 (local address 127.0.0.1:38040)
0808 07:10:01.441772 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.441781 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:01.441818 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:01.441963 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:01.441964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:01.442106 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:01.442140 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.442142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.442943 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.442944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.443634 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.443636 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.443973 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.443974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.444014 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.444371 (+ 357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:01.444375 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:01.445587 (+ 1212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:01.447203 (+ 1616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.447204 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.447204 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.447361 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.447553 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.447554 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.447554 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.447608 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.447826 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:01.447827 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:01.447873 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 07:10:01.447930 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 07:10:01.448033 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 07:10:01.448413 30601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.441780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38040 (local address 127.29.82.124:38977)
0808 07:10:01.441810 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.441812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.441819 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:10:01.441875 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.441876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.441885 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.441922 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.442203 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.442862 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.443711 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.443905 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.443970 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.445669 (+ 1699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.445670 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.445671 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.445678 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.447130 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.447428 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.447430 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.447430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.447488 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.447664 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.447665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.447665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.447770 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.447820 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.447974 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.448091 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":17}
I20260808 07:10:01.449126 30486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.441864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59088 (local address 127.29.82.125:41735)
0808 07:10:01.441897 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.441899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.441907 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:10:01.441928 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.441929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.441937 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.441980 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.442447 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.443074 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.443934 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.444169 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.444218 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.446323 (+ 2105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.446325 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.446325 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.446333 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.447559 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.447863 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.447864 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.447864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.447914 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.448610 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.448611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.448612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.448754 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.448922 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.448965 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.449043 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 07:10:01.450058 30597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29: Bootstrap starting.
I20260808 07:10:01.451133 30597 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29: Neither blocks nor log segments found. Creating new log.
I20260808 07:10:01.451318 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:10:01.451591 30597 log.cc:824] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29: Log is configured to *not* fsync() on all Append() calls
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173001, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for kudu/127.29.82.124@KRBTEST.COM
I20260808 07:10:01.452719 30597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29: No bootstrap required, opened a new log
I20260808 07:10:01.452427 30335 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60374
I20260808 07:10:01.454809 30597 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } }
I20260808 07:10:01.454938 30597 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d9a797f83146f7bcd5253708f7be29, State: Initialized, Role: FOLLOWER
I20260808 07:10:01.455019 30597 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } }
I20260808 07:10:01.455341 30605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } } }
I20260808 07:10:01.455396 30597 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:10:01.455466 30605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:10:01.455849 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.448259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:38977 (local address 127.0.0.1:38042)
0808 07:10:01.448317 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.448328 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:01.448367 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:01.448674 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:01.448676 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:01.448833 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:01.448882 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.448884 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.449694 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.449695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.450409 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.450413 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.450915 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.450916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.450980 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.451476 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:01.451482 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:01.452867 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:01.454719 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.454720 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.454720 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.454956 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.455162 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.455163 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.455163 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.455217 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.455532 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:01.455533 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:01.455586 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 07:10:01.455647 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:10:01.455755 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 07:10:01.455848 30601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.448364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38042 (local address 127.29.82.124:38977)
0808 07:10:01.448582 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.448584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.448591 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:10:01.448609 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.448609 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.448618 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.448662 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.448966 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.449610 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.450524 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.450805 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.450864 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.452968 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.452970 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.452970 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.452978 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.454616 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.455036 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.455037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.455038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.455096 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.455277 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.455277 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.455278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.455435 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.455500 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.455684 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.455757 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":115,"threads_started":1}
I20260808 07:10:01.457531 30372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33: Bootstrap starting.
W20260808 07:10:01.457643 30621 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:10:01.457688 30621 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:10:01.458292 30372 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33: Neither blocks nor log segments found. Creating new log.
I20260808 07:10:01.458609 30372 log.cc:824] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:01.459640 30372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33: No bootstrap required, opened a new log
I20260808 07:10:01.457912 30490 master_runner.cc:186] Error getting master registration for 127.29.82.126:38781: OK, instance_id { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" instance_seqno: 1786173001103339 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:10:01.460384 30490 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:10:01.461022 30372 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } }
I20260808 07:10:01.461198 30372 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe7c5ede47c4ae292e4229a3d1f7c33, State: Initialized, Role: FOLLOWER
I20260808 07:10:01.461287 30372 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } }
I20260808 07:10:01.461630 30372 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:10:01.461676 30335 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 07:10:01.461591 30624 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } } }
I20260808 07:10:01.461743 30335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:10:01.461823 30624 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:10:01.462574 30335 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } }
I20260808 07:10:01.462826 30335 leader_election.cc:288] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [CANDIDATE]: Term 1 election: Requested vote from peers 4525beef1b38491bb450ba48b43171ec (127.29.82.125:41735), 24d9a797f83146f7bcd5253708f7be29 (127.29.82.124:38977)
I20260808 07:10:01.463397 30562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "24d9a797f83146f7bcd5253708f7be29"
I20260808 07:10:01.463517 30562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:10:01.464357 30562 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe7c5ede47c4ae292e4229a3d1f7c33 in term 1.
I20260808 07:10:01.464630 30289 leader_election.cc:302] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d9a797f83146f7bcd5253708f7be29, fbe7c5ede47c4ae292e4229a3d1f7c33; no voters:
I20260808 07:10:01.464742 30624 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:10:01.464926 30624 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [term 1 LEADER]: Becoming Leader. State: Replica: fbe7c5ede47c4ae292e4229a3d1f7c33, State: Running, Role: LEADER
I20260808 07:10:01.465026 30624 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } }
I20260808 07:10:01.465494 30624 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbe7c5ede47c4ae292e4229a3d1f7c33. Latest consensus state: current_term: 1 leader_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } } }
I20260808 07:10:01.465587 30624 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [sys.catalog]: This master's current role is: LEADER
W20260808 07:10:01.466179 30638 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:10:01.466244 30638 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:10:01.466714 30268 master_runner.cc:186] Error getting master registration for 127.29.82.125:41735: OK, instance_id { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" instance_seqno: 1786173001263457 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:10:01.469043 30268 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:10:01.473285 30652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:10:01.473520 30652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:10:01.473909 30486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.464046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59094 (local address 127.29.82.125:41735)
0808 07:10:01.464095 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.464097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.465380 (+ 1283us) server_negotiation.cc:407] Connection header received
0808 07:10:01.465439 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.465441 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.465462 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.465522 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.466594 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.467285 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.468294 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.468596 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.468638 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.470371 (+ 1733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.470373 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.470373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.470381 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.472437 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.472857 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.472858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.472859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.472921 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.473123 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.473124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.473124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.473298 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.473387 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.473737 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.473823 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:10:01.478576 30562 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29 [term 1 FOLLOWER]: Refusing update from remote peer fbe7c5ede47c4ae292e4229a3d1f7c33: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:10:01.478950 30624 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:10:01.480489 30605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbe7c5ede47c4ae292e4229a3d1f7c33. Latest consensus state: current_term: 1 leader_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } } }
I20260808 07:10:01.480644 30605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:10:01.482527 30601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.466889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38054 (local address 127.29.82.124:38977)
0808 07:10:01.466927 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.466929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.475035 (+ 8106us) server_negotiation.cc:407] Connection header received
0808 07:10:01.475094 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.475095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.475128 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.475160 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.475769 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.476483 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.477469 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.477721 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.477767 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.479536 (+ 1769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.479538 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.479538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.479547 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.481129 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.481665 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.481667 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.481667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.481727 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.481925 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.481926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.481926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.482056 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.482127 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.482339 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.482421 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:10:01.486836 30374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.466546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60380 (local address 127.29.82.126:38781)
0808 07:10:01.466592 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.466594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.474619 (+ 8025us) server_negotiation.cc:407] Connection header received
0808 07:10:01.474712 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.474713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.474724 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.474753 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.475370 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.476139 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.477700 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.478000 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.478040 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.483280 (+ 5240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.483282 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.483282 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.483291 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.484969 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.485422 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.485424 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.485424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.485516 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.486142 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.486143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.486143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.486305 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.486396 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.486656 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.486742 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:10:01.487646 30657 mvcc.cc:205] Tried to move back new op lower bound from 7316164614051655680 to 7316164614001647616. Current Snapshot: MvccSnapshot[applied={T|T < 7316164614051655680}]
I20260808 07:10:01.487876 30624 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } } }
I20260808 07:10:01.487972 30624 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [sys.catalog]: This master's current role is: LEADER
I20260808 07:10:01.488570 30605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } } }
I20260808 07:10:01.488638 30652 catalog_manager.cc:1347] Generated new cluster ID: 8bcbab4a33e2467b856edecd2321a475
I20260808 07:10:01.488667 30605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:10:01.488684 30652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:10:01.489024 30659 mvcc.cc:205] Tried to move back new op lower bound from 7316164614051655680 to 7316164614001647616. Current Snapshot: MvccSnapshot[applied={T|T < 7316164614051655680}]
I20260808 07:10:01.498268 30479 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } attempt: 3
Aug 08 07:10:01 dist-test-slave-rmhg krb5kdc[30249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173001, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.125@KRBTEST.COM for kudu/127.29.82.124@KRBTEST.COM
I20260808 07:10:01.507092 30481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.498636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:38977 (local address 127.0.0.1:38058)
0808 07:10:01.498751 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:01.498763 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:01.498814 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:01.498966 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:01.498968 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:01.499155 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:01.499207 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.499209 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.500118 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.500120 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.500907 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:01.500909 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.501725 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.501726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:01.501796 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.502311 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:01.502318 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:01.503999 (+ 1681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:01.505947 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.505948 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.505949 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.506167 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.506407 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:01.506407 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:01.506407 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:01.506484 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:01.506771 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:01.506772 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:01.506828 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 07:10:01.506881 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 07:10:01.506982 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92}
I20260808 07:10:01.507622 30601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:01.498700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38058 (local address 127.29.82.124:38977)
0808 07:10:01.498756 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.498758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.498799 (+ 41us) server_negotiation.cc:407] Connection header received
0808 07:10:01.498888 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.498889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.498899 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.498944 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.499292 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.500034 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.501286 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:01.501593 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:01.501648 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:01.504102 (+ 2454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:01.504104 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:01.504105 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:01.504113 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:01.505846 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.506244 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.506245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.506246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.506317 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:01.506548 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:01.506549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:01.506549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:01.506686 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:01.506734 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:01.507464 (+ 730us) server_negotiation.cc:299] Negotiation successful
0808 07:10:01.507539 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:10:01.510303 30479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec: Bootstrap starting.
I20260808 07:10:01.510968 30479 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec: Neither blocks nor log segments found. Creating new log.
I20260808 07:10:01.511293 30479 log.cc:824] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:01.512266 30479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec: No bootstrap required, opened a new log
I20260808 07:10:01.513948 30479 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } }
I20260808 07:10:01.514084 30479 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4525beef1b38491bb450ba48b43171ec, State: Initialized, Role: FOLLOWER
I20260808 07:10:01.514164 30479 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } }
I20260808 07:10:01.514535 30479 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:10:01.516222 30437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4525beef1b38491bb450ba48b43171ec"
I20260808 07:10:01.516335 30437 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec [term 0 FOLLOWER]: Advancing to term 1
W20260808 07:10:01.516492 30683 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:10:01.516587 30683 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:10:01.517104 30437 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe7c5ede47c4ae292e4229a3d1f7c33 in term 1.
I20260808 07:10:01.517501 30435 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec [term 1 FOLLOWER]: Refusing update from remote peer fbe7c5ede47c4ae292e4229a3d1f7c33: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:10:01.517907 30648 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:10:01.518117 30666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } } }
I20260808 07:10:01.518191 30666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:10:01.517976 30652 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:10:01.519083 30652 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:10:01.519440 30666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbe7c5ede47c4ae292e4229a3d1f7c33. Latest consensus state: current_term: 1 leader_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } } }
I20260808 07:10:01.519531 30666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:10:01.519562 30666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } } }
I20260808 07:10:01.519596 30666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:10:01.525512 30648 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe7c5ede47c4ae292e4229a3d1f7c33" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 38781 } } peers { permanent_uuid: "4525beef1b38491bb450ba48b43171ec" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 41735 } } peers { permanent_uuid: "24d9a797f83146f7bcd5253708f7be29" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 38977 } } }
I20260808 07:10:01.525617 30648 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33 [sys.catalog]: This master's current role is: LEADER
I20260808 07:10:01.529247 30652 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbe7c5ede47c4ae292e4229a3d1f7c33: Generated new TSK 0
I20260808 07:10:01.529549 30652 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:10:01.532744 30685 mvcc.cc:205] Tried to move back new op lower bound from 7316164614179405824 to 7316164614001647616. Current Snapshot: MvccSnapshot[applied={T|T < 7316164614051655680}]
W20260808 07:10:01.555786 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:01.554639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59102 (local address 127.29.82.125:41735)
0808 07:10:01.554688 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.554690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.555018 (+ 328us) server_negotiation.cc:407] Connection header received
0808 07:10:01.555126 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.555127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.555138 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.555183 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.555704 (+ 521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59102: BlockingRecv error: recv got EOF from 127.0.0.1:59102 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260808 07:10:01.557003 30374 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:01.556199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60386 (local address 127.29.82.126:38781)
0808 07:10:01.556237 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.556239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.556430 (+ 191us) server_negotiation.cc:407] Connection header received
0808 07:10:01.556524 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.556525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.556535 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.556563 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.556887 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60386: BlockingRecv error: recv got EOF from 127.0.0.1:60386 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 07:10:01.557977 30601 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:01.557316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38070 (local address 127.29.82.124:38977)
0808 07:10:01.557357 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.557359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.557482 (+ 123us) server_negotiation.cc:407] Connection header received
0808 07:10:01.557567 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.557568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.557578 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.557606 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.557904 (+ 298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38070: BlockingRecv error: recv got EOF from 127.0.0.1:38070 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 07:10:01.560199 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:01.559407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59116 (local address 127.29.82.125:41735)
0808 07:10:01.559444 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.559445 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.559683 (+ 238us) server_negotiation.cc:407] Connection header received
0808 07:10:01.559782 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.559783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.559802 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.559829 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.560146 (+ 317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59116: BlockingRecv error: recv got EOF from 127.0.0.1:59116 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 07:10:01.563215 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:01.562385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59126 (local address 127.29.82.125:41735)
0808 07:10:01.562430 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.562432 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.562708 (+ 276us) server_negotiation.cc:407] Connection header received
0808 07:10:01.562797 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.562798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.562809 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.562836 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.563165 (+ 329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59126: BlockingRecv error: recv got EOF from 127.0.0.1:59126 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260808 07:10:01.567039 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:01.566267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59136 (local address 127.29.82.125:41735)
0808 07:10:01.566301 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.566303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.566543 (+ 240us) server_negotiation.cc:407] Connection header received
0808 07:10:01.566634 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.566635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.566645 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.566672 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.566990 (+ 318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59136: BlockingRecv error: recv got EOF from 127.0.0.1:59136 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 07:10:01.573206 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:01.572271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59150 (local address 127.29.82.125:41735)
0808 07:10:01.572311 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.572313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.572598 (+ 285us) server_negotiation.cc:407] Connection header received
0808 07:10:01.572701 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.572702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.572713 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.572741 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.573119 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59150: BlockingRecv error: recv got EOF from 127.0.0.1:59150 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 07:10:01.583597 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:01.582551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59162 (local address 127.29.82.125:41735)
0808 07:10:01.582599 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.582601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.582953 (+ 352us) server_negotiation.cc:407] Connection header received
0808 07:10:01.583071 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.583072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.583085 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.583116 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.583533 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59162: BlockingRecv error: recv got EOF from 127.0.0.1:59162 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 07:10:01.602090 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:01.601003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59178 (local address 127.29.82.125:41735)
0808 07:10:01.601053 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.601055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.601418 (+ 363us) server_negotiation.cc:407] Connection header received
0808 07:10:01.601545 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.601546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.601559 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.601591 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.602025 (+ 434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59178: BlockingRecv error: recv got EOF from 127.0.0.1:59178 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 07:10:01.636479 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:01.635494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59184 (local address 127.29.82.125:41735)
0808 07:10:01.635559 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.635561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.635876 (+ 315us) server_negotiation.cc:407] Connection header received
0808 07:10:01.635976 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.635977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.635990 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.636019 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.636414 (+ 395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59184: BlockingRecv error: recv got EOF from 127.0.0.1:59184 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 07:10:01.702484 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:01.701899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59194 (local address 127.29.82.125:41735)
0808 07:10:01.702007 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.702009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.702023 (+ 14us) server_negotiation.cc:407] Connection header received
0808 07:10:01.702055 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.702055 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.702065 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.702128 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.702421 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59194: BlockingRecv error: recv got EOF from 127.0.0.1:59194 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260808 07:10:01.832516 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:01.831726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59202 (local address 127.29.82.125:41735)
0808 07:10:01.831816 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:01.831818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:01.831831 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:10:01.831898 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:01.831899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:01.831910 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:01.831975 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:01.832400 (+ 425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59202: BlockingRecv error: recv got EOF from 127.0.0.1:59202 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 07:10:02.090452 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:02.089795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59216 (local address 127.29.82.125:41735)
0808 07:10:02.089878 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:02.089880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:02.089890 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:10:02.089943 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:02.089944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:02.089957 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:02.090008 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:02.090387 (+ 379us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59216: BlockingRecv error: recv got EOF from 127.0.0.1:59216 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 07:10:02.458160 30621 catalog_manager.cc:1259] Loaded cluster ID: 8bcbab4a33e2467b856edecd2321a475
I20260808 07:10:02.458247 30621 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29: loading cluster ID for follower catalog manager: success
I20260808 07:10:02.459069 30621 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29: acquiring CA information for follower catalog manager: success
I20260808 07:10:02.459363 30621 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 24d9a797f83146f7bcd5253708f7be29: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:10:02.517110 30683 catalog_manager.cc:1259] Loaded cluster ID: 8bcbab4a33e2467b856edecd2321a475
I20260808 07:10:02.517222 30683 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec: loading cluster ID for follower catalog manager: success
I20260808 07:10:02.517997 30683 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec: acquiring CA information for follower catalog manager: success
I20260808 07:10:02.518263 30683 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4525beef1b38491bb450ba48b43171ec: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:10:02.606406 30786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:02.603682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59226 (local address 127.29.82.125:41735)
0808 07:10:02.603796 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:02.603798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:02.603854 (+ 56us) server_negotiation.cc:407] Connection header received
0808 07:10:02.603908 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:02.603909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:02.603964 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:02.604038 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:10:02.604158 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:02.604752 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:02.605580 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:02.605793 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:02.605857 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:02.606056 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:10:02.606178 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:10:02.606248 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:02.606287 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 07:10:02.606310 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":60,"threads_started":1}
I20260808 07:10:02.610726 30796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:02.608197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38074 (local address 127.29.82.124:38977)
0808 07:10:02.608311 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:02.608313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:02.608323 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:10:02.608365 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:02.608365 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:02.608402 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:02.608487 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:10:02.608609 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:02.609124 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:02.609910 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:02.610124 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:02.610186 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:02.610349 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:10:02.610496 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:10:02.610568 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:02.610633 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 07:10:02.610656 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":56,"threads_started":1}
I20260808 07:10:02.615518 30796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:02.612768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38078 (local address 127.29.82.124:38977)
0808 07:10:02.612810 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:02.612812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:02.612818 (+ 6us) server_negotiation.cc:407] Connection header received
0808 07:10:02.612839 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:02.612839 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:02.612849 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:02.612896 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:10:02.613004 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:02.613695 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:02.614764 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:02.615069 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:02.615125 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:02.615253 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:10:02.615288 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:10:02.615335 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:02.615406 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 07:10:02.615432 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:10:02.615556 30786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:02.612371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59228 (local address 127.29.82.125:41735)
0808 07:10:02.612417 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:02.612418 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:02.612739 (+ 321us) server_negotiation.cc:407] Connection header received
0808 07:10:02.612771 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:02.612772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:02.612784 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:02.612834 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:10:02.613001 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:02.613617 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:02.614715 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:02.615013 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:02.615070 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:02.615304 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:10:02.615338 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:10:02.615389 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:02.615452 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 07:10:02.615478 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:10:02.615831 30805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:02.612332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60392 (local address 127.29.82.126:38781)
0808 07:10:02.612614 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:02.612616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:02.612805 (+ 189us) server_negotiation.cc:407] Connection header received
0808 07:10:02.612861 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:02.612862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:02.612918 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:02.612994 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:10:02.613263 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:02.613964 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:02.614755 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:02.614985 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:02.615052 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:02.615243 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:10:02.615354 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:10:02.615407 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:02.615626 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 07:10:02.615652 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":62,"threads_started":1}
I20260808 07:10:02.617372 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 30268
I20260808 07:10:02.631197 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 30381
I20260808 07:10:02.639614 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 30490
2026-08-08T07:10:02Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2912 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:10:02 dist-test-slave-rmhg krb5kdc[30813](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:10:02 dist-test-slave-rmhg krb5kdc[30813](info): set up 2 sockets
Aug 08 07:10:02 dist-test-slave-rmhg krb5kdc[30813](info): commencing operation
krb5kdc: starting...
W20260808 07:10:03.768532 30025 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/test-user.keytab.
Aug 08 07:10:03 dist-test-slave-rmhg krb5kdc[30813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:10:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:10:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.82.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
Entry for principal kudu/127.29.82.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab.
I20260808 07:10:03.895920 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:45997
--webserver_interface=127.29.82.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:44949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:45997,127.29.82.125:45353,127.29.82.124:35653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:10:03.981770 30832 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:10:03.982017 30832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:03.982043 30832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:03.982069 30832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:03.983249 30832 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:10:03.983299 30832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:03.983317 30832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:03.983335 30832 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:10:03.983348 30832 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:10:03.984930 30832 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:44949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:45997,127.29.82.125:45353,127.29.82.124:35653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.126.keytab
--principal=kudu/127.29.82.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.126:45997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.82.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:10:03.985262 30832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:03.985492 30832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:03.990553 30843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:03.990492 30840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:03.990669 30832 server_base.cc:1034] running on GCE node
W20260808 07:10:03.990480 30841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:03.991031 30832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:03.991312 30832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:03.992451 30832 hybrid_clock.cc:648] HybridClock initialized: now 1786173003992438 us; error 33 us; skew 500 ppm
Aug 08 07:10:03 dist-test-slave-rmhg krb5kdc[30813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173003, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:03.998996 30832 init.cc:377] Logged in from keytab as kudu/127.29.82.126@KRBTEST.COM (short username kudu)
I20260808 07:10:03.999568 30832 webserver.cc:460] Webserver started at http://127.29.82.126:36651/ using document root <none> and password file <none>
I20260808 07:10:03.999786 30832 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:03.999832 30832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:03.999956 30832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:10:04.001055 30832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/data/instance:
uuid: "8b290f7d42ac4f858ec2f5901a1b8691"
format_stamp: "Formatted at 2026-08-08 07:10:03 on dist-test-slave-rmhg"
server_key: "e3db0b6cbd6ced500da936df1ae34f6a"
server_key_iv: "fa748d9651f6c55c3b79f2ad9968b338"
server_key_version: "encryptionkey@0"
I20260808 07:10:04.001442 30832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/wal/instance:
uuid: "8b290f7d42ac4f858ec2f5901a1b8691"
format_stamp: "Formatted at 2026-08-08 07:10:03 on dist-test-slave-rmhg"
server_key: "e3db0b6cbd6ced500da936df1ae34f6a"
server_key_iv: "fa748d9651f6c55c3b79f2ad9968b338"
server_key_version: "encryptionkey@0"
I20260808 07:10:04.002779 30832 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:10:04.003476 30853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:04.003628 30832 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:10:04.003720 30832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/wal
uuid: "8b290f7d42ac4f858ec2f5901a1b8691"
format_stamp: "Formatted at 2026-08-08 07:10:03 on dist-test-slave-rmhg"
server_key: "e3db0b6cbd6ced500da936df1ae34f6a"
server_key_iv: "fa748d9651f6c55c3b79f2ad9968b338"
server_key_version: "encryptionkey@0"
I20260808 07:10:04.003782 30832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:04.042371 30832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:04.044623 30832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:04.044770 30832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:04.048808 30832 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.126:45997
I20260808 07:10:04.048858 30934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.126:45997 every 8 connection(s)
I20260808 07:10:04.049227 30832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/data/info.pb
I20260808 07:10:04.050223 30937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:10:04.051803 30937 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:10:04.052476 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 30832
I20260808 07:10:04.052582 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-0/wal/instance
I20260808 07:10:04.052773 30025 external_mini_cluster.cc:1428] Setting key c9f121469746c77a27831cf530c96540
Aug 08 07:10:04 dist-test-slave-rmhg krb5kdc[30813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173003, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.82.125@KRBTEST.COM; defaulting to no policy
I20260808 07:10:04.062031 30940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.052566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47118 (local address 127.29.82.126:45997)
0808 07:10:04.052769 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.052780 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.052921 (+ 141us) server_negotiation.cc:407] Connection header received
0808 07:10:04.053529 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.053532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.053557 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.053670 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.054189 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.055175 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.056170 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.056469 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.056567 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.058848 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.058856 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.058856 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.058863 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.060362 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.060798 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.060801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.060801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.060879 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.061125 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.061125 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.061126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.061381 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.061450 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.061688 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.061792 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":96,"threads_started":1}
I20260808 07:10:04.062034 30941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.052566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45997 (local address 127.0.0.1:47118)
0808 07:10:04.052792 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.052832 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:04.053371 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:04.053670 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:04.053672 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:04.053918 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:04.054101 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.054105 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.055277 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.055278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.056106 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.056108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.056570 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.056571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.056636 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.057145 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:04.057193 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:04.058760 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:04.060447 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.060455 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.060458 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.060718 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.060941 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.060942 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.060943 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.061065 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.061453 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:04.061462 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:04.061542 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 07:10:04.061642 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 07:10:04.061883 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":70,"spinlock_wait_cycles":9088,"thread_start_us":105,"threads_started":1}
I20260808 07:10:04.062827 30937 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:10:04.063148 30941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.063056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:45353 (local address 127.0.0.1:48822)
0808 07:10:04.063086 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.063129 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:45353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260808 07:10:04.063274 30854 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.82.125:45353: connect: Connection refused (error 111)
I20260808 07:10:04.063696 30941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.063615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:45353 (local address 127.0.0.1:48838)
0808 07:10:04.063655 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.063679 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:45353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 07:10:04.063798 30937 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.125:45353: Network error: Client connection negotiation failed: client connection to 127.29.82.125:45353: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.125.keytab.
Entry for principal kudu/127.29.82.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.125.keytab.
I20260808 07:10:04.079823 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.125:45353
--webserver_interface=127.29.82.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.125.keytab
--principal=kudu/127.29.82.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:44949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:45997,127.29.82.125:45353,127.29.82.124:35653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:10:04.113022 30937 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } attempt: 1
I20260808 07:10:04.113551 30941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.113416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:45353 (local address 127.0.0.1:48850)
0808 07:10:04.113483 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.113518 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:45353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 07:10:04.113924 30941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.113830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:45353 (local address 127.0.0.1:48866)
0808 07:10:04.113877 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.113902 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:45353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 07:10:04.114037 30937 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.125:45353: Network error: Client connection negotiation failed: client connection to 127.29.82.125:45353: connect: Connection refused (error 111)
W20260808 07:10:04.164361 30945 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:10:04.164660 30945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:04.164690 30945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:04.164728 30945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:04.166024 30945 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:10:04.166075 30945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:04.166095 30945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:04.166112 30945 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:10:04.166128 30945 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:10:04.167709 30945 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:44949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:45997,127.29.82.125:45353,127.29.82.124:35653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.125.keytab
--principal=kudu/127.29.82.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.125:45353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.82.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:10:04.167972 30945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:04.168198 30945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:04.172994 30951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:04.172987 30955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:04.172991 30950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:04.173214 30945 server_base.cc:1034] running on GCE node
I20260808 07:10:04.173508 30945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:04.173828 30945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:04.175007 30945 hybrid_clock.cc:648] HybridClock initialized: now 1786173004174981 us; error 33 us; skew 500 ppm
Aug 08 07:10:04 dist-test-slave-rmhg krb5kdc[30813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173004, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:04.177587 30945 init.cc:377] Logged in from keytab as kudu/127.29.82.125@KRBTEST.COM (short username kudu)
I20260808 07:10:04.178102 30945 webserver.cc:460] Webserver started at http://127.29.82.125:39725/ using document root <none> and password file <none>
I20260808 07:10:04.178311 30945 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:04.178362 30945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:04.178490 30945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:10:04.179565 30945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/data/instance:
uuid: "0803e608c43446e3bf7c7f4220b837c2"
format_stamp: "Formatted at 2026-08-08 07:10:04 on dist-test-slave-rmhg"
server_key: "437b32f97db55dc0b7dd1c07dc1187cf"
server_key_iv: "f2d2a8e03816caa750ff8e39a9f45494"
server_key_version: "encryptionkey@0"
I20260808 07:10:04.179906 30945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/wal/instance:
uuid: "0803e608c43446e3bf7c7f4220b837c2"
format_stamp: "Formatted at 2026-08-08 07:10:04 on dist-test-slave-rmhg"
server_key: "437b32f97db55dc0b7dd1c07dc1187cf"
server_key_iv: "f2d2a8e03816caa750ff8e39a9f45494"
server_key_version: "encryptionkey@0"
I20260808 07:10:04.181267 30945 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:10:04.182016 30964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:04.182232 30945 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:10:04.182192 30937 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } attempt: 2
I20260808 07:10:04.182328 30945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/wal
uuid: "0803e608c43446e3bf7c7f4220b837c2"
format_stamp: "Formatted at 2026-08-08 07:10:04 on dist-test-slave-rmhg"
server_key: "437b32f97db55dc0b7dd1c07dc1187cf"
server_key_iv: "f2d2a8e03816caa750ff8e39a9f45494"
server_key_version: "encryptionkey@0"
I20260808 07:10:04.182401 30945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:04.182631 30941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.182496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:45353 (local address 127.0.0.1:48876)
0808 07:10:04.182558 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.182584 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:45353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 07:10:04.182967 30941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.182888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:45353 (local address 127.0.0.1:48884)
0808 07:10:04.182926 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.182951 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.125:45353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 07:10:04.183058 30937 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.125:45353: Network error: Client connection negotiation failed: client connection to 127.29.82.125:45353: connect: Connection refused (error 111)
I20260808 07:10:04.212726 30945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:04.214972 30945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:04.215101 30945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:04.219063 30945 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.125:45353
I20260808 07:10:04.219095 31042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.125:45353 every 8 connection(s)
I20260808 07:10:04.219452 30945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/data/info.pb
I20260808 07:10:04.220528 31043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:10:04.222216 31043 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:10:04.226060 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 30945
I20260808 07:10:04.226138 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-1/wal/instance
I20260808 07:10:04.226315 30025 external_mini_cluster.cc:1428] Setting key 695118d3579f77ea9df7362df63bade5
Aug 08 07:10:04 dist-test-slave-rmhg krb5kdc[30813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173004, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.125@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
I20260808 07:10:04.231113 30940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.222912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47128 (local address 127.29.82.126:45997)
0808 07:10:04.222970 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.222973 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.223192 (+ 219us) server_negotiation.cc:407] Connection header received
0808 07:10:04.223679 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.223680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.223693 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.223746 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.224395 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.224934 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.225949 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.226191 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.226255 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.228513 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.228515 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.228515 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.228530 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.229804 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.230194 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.230195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.230196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.230251 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.230472 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.230473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.230473 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.230596 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.230654 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.230921 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.231007 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:10:04.231282 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.222869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45997 (local address 127.0.0.1:47128)
0808 07:10:04.223063 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.223105 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:04.223576 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:04.223817 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:04.223821 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:04.224088 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:04.224298 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.224302 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.225030 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.225031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.225859 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.225861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.226285 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.226286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.226407 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.226912 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:04.226920 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:04.228416 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:04.229880 (+ 1464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.229888 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.229891 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.230125 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.230306 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.230307 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.230307 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.230415 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.230652 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:04.230659 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:04.230802 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 07:10:04.230892 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 07:10:04.231059 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":91,"threads_started":1}
I20260808 07:10:04.231835 31043 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.29.82.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.82.124@KRBTEST.COM" created.
Aug 08 07:10:04 dist-test-slave-rmhg krb5kdc[30813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173004, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.125@KRBTEST.COM for kudu/127.29.82.125@KRBTEST.COM
I20260808 07:10:04.240638 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.232074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:45353 (local address 127.0.0.1:48886)
0808 07:10:04.232129 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.232142 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:04.232191 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:04.232418 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:04.232419 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:04.232571 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:04.232635 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.232637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.233510 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.233512 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.234276 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.234279 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.234825 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.234827 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.234900 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.235242 (+ 342us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:04.235246 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:04.238070 (+ 2824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:04.239663 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.239664 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.239665 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.239818 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.239988 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.239988 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.239989 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.240041 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.240297 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:04.240298 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:04.240337 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 07:10:04.240403 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 07:10:04.240522 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 07:10:04.240793 31050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.232142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48886 (local address 127.29.82.125:45353)
0808 07:10:04.232287 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.232292 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.232311 (+ 19us) server_negotiation.cc:407] Connection header received
0808 07:10:04.232330 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.232332 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.232342 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.232401 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.232699 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.233436 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.234372 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.234750 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.234813 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.238151 (+ 3338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.238163 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.238164 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.238171 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.239584 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.239884 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.239887 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.239888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.239935 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.240091 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.240092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.240092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.240239 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.240310 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.240449 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.240595 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":117,"thread_start_us":79,"threads_started":1}
I20260808 07:10:04.241393 31043 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:10:04.241766 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.241643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:35653 (local address 127.0.0.1:42782)
0808 07:10:04.241681 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.241739 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260808 07:10:04.241896 30966 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
I20260808 07:10:04.242336 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.242229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:35653 (local address 127.0.0.1:42796)
0808 07:10:04.242281 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.242312 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 07:10:04.242452 31043 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:35653: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.82.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.124.keytab.
Entry for principal kudu/127.29.82.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.124.keytab.
I20260808 07:10:04.252940 30025 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
/tmp/dist-test-taskZ8Eis0/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.124:35653
--webserver_interface=127.29.82.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.124.keytab
--principal=kudu/127.29.82.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.82.84:44949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.82.126:45997,127.29.82.125:45353,127.29.82.124:35653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:10:04.274240 30937 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } attempt: 3
Aug 08 07:10:04 dist-test-slave-rmhg krb5kdc[30813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173003, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for kudu/127.29.82.125@KRBTEST.COM
I20260808 07:10:04.281206 31050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.274716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48894 (local address 127.29.82.125:45353)
0808 07:10:04.274783 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.274785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.274795 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:10:04.274822 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.274823 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.274833 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.274878 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.275212 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.275715 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.276401 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.276627 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.276685 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.278877 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.278879 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.278879 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.278888 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.280142 (+ 1254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.280451 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.280452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.280452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.280506 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.280675 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.280675 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.280676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.280798 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.280859 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.280996 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.281078 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 07:10:04.281206 30941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.274627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:45353 (local address 127.0.0.1:48894)
0808 07:10:04.274698 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.274709 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:04.274755 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:04.274890 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:04.274898 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:04.275063 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:04.275134 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.275136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.275793 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.275794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.276325 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.276327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.276691 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.276692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.276765 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.277294 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:04.277300 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:04.278766 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:04.280219 (+ 1453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.280220 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.280221 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.280389 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.280561 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.280562 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.280562 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.280624 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.280855 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:04.280856 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:04.280908 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 07:10:04.280967 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 07:10:04.281078 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 07:10:04.281786 30937 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:10:04.282138 30941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.282039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:35653 (local address 127.0.0.1:42804)
0808 07:10:04.282083 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.282116 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 07:10:04.282435 30941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.282349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:35653 (local address 127.0.0.1:42820)
0808 07:10:04.282387 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.282411 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 07:10:04.282519 30937 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:35653: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
I20260808 07:10:04.291707 31043 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } attempt: 1
I20260808 07:10:04.292184 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.292068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:35653 (local address 127.0.0.1:42824)
0808 07:10:04.292121 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.292156 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 07:10:04.292555 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.292428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:35653 (local address 127.0.0.1:42836)
0808 07:10:04.292513 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.292537 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260808 07:10:04.292660 31043 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:35653: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
I20260808 07:10:04.313671 30937 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } attempt: 1
I20260808 07:10:04.314224 30941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.314075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:35653 (local address 127.0.0.1:42846)
0808 07:10:04.314145 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.314189 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 07:10:04.314643 30941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.314517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:35653 (local address 127.0.0.1:42852)
0808 07:10:04.314581 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.314613 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 07:10:04.314759 30937 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:35653: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
W20260808 07:10:04.337456 31054 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:10:04.337705 31054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:10:04.337731 31054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:10:04.337756 31054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:10:04.338920 31054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:10:04.338965 31054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:10:04.338984 31054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:10:04.338999 31054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:10:04.339016 31054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:10:04.340553 31054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.82.84:44949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.82.126:45997,127.29.82.125:45353,127.29.82.124:35653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/krb5kdc/kudu_127.29.82.124.keytab
--principal=kudu/127.29.82.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.82.124:35653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.82.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 05:42:04 UTC on ccycloud.quasar-fxrzxs.root.comops.site
build id 4574018
I20260808 07:10:04.340809 31054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:10:04.341030 31054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:10:04.345785 31060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:10:04.345778 31061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:04.345868 31054 server_base.cc:1034] running on GCE node
W20260808 07:10:04.345785 31066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:10:04.346187 31054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:10:04.346482 31054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:10:04.347623 31054 hybrid_clock.cc:648] HybridClock initialized: now 1786173004347615 us; error 33 us; skew 500 ppm
Aug 08 07:10:04 dist-test-slave-rmhg krb5kdc[30813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173004, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:10:04.350026 31054 init.cc:377] Logged in from keytab as kudu/127.29.82.124@KRBTEST.COM (short username kudu)
I20260808 07:10:04.350481 31054 webserver.cc:460] Webserver started at http://127.29.82.124:40229/ using document root <none> and password file <none>
I20260808 07:10:04.350667 31054 fs_manager.cc:359] Metadata directory not provided
I20260808 07:10:04.350708 31054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:10:04.350795 31054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:10:04.351833 31054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/data/instance:
uuid: "62889624bd384e9890b9270e85b67c27"
format_stamp: "Formatted at 2026-08-08 07:10:04 on dist-test-slave-rmhg"
server_key: "a481e336e972f3cb5cce8bc30cf842dd"
server_key_iv: "2dcbc43f1721f47b44a50661463a3811"
server_key_version: "encryptionkey@0"
I20260808 07:10:04.352129 31054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/wal/instance:
uuid: "62889624bd384e9890b9270e85b67c27"
format_stamp: "Formatted at 2026-08-08 07:10:04 on dist-test-slave-rmhg"
server_key: "a481e336e972f3cb5cce8bc30cf842dd"
server_key_iv: "2dcbc43f1721f47b44a50661463a3811"
server_key_version: "encryptionkey@0"
I20260808 07:10:04.353389 31054 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:10:04.354104 31076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:10:04.354264 31054 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:10:04.354344 31054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/data,/tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/wal
uuid: "62889624bd384e9890b9270e85b67c27"
format_stamp: "Formatted at 2026-08-08 07:10:04 on dist-test-slave-rmhg"
server_key: "a481e336e972f3cb5cce8bc30cf842dd"
server_key_iv: "2dcbc43f1721f47b44a50661463a3811"
server_key_version: "encryptionkey@0"
I20260808 07:10:04.354411 31054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:10:04.360836 31043 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } attempt: 2
I20260808 07:10:04.361294 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.361180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:35653 (local address 127.0.0.1:42866)
0808 07:10:04.361228 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.361266 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 07:10:04.361675 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.361570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:35653 (local address 127.0.0.1:42872)
0808 07:10:04.361614 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.361644 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 07:10:04.361827 31043 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.82.124:35653: Network error: Client connection negotiation failed: client connection to 127.29.82.124:35653: connect: Connection refused (error 111)
I20260808 07:10:04.367642 31054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:10:04.369805 31054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:10:04.369933 31054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:10:04.373695 31054 rpc_server.cc:307] RPC server started. Bound to: 127.29.82.124:35653
I20260808 07:10:04.373737 31148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.82.124:35653 every 8 connection(s)
I20260808 07:10:04.374111 31054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/data/info.pb
I20260808 07:10:04.375164 31150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:10:04.377226 31150 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:10:04.378607 30025 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu as pid 31054
I20260808 07:10:04.378703 30025 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZ8Eis0/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172701750152-30025-0/minicluster-data/master-2/wal/instance
I20260808 07:10:04.378894 30025 external_mini_cluster.cc:1428] Setting key 8eabc91cc358d9e176e4a1e926d268f7
Aug 08 07:10:04 dist-test-slave-rmhg krb5kdc[30813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173004, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.124@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
Aug 08 07:10:04 dist-test-slave-rmhg krb5kdc[30813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.124@KRBTEST.COM
I20260808 07:10:04.387742 30940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.378057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47134 (local address 127.29.82.126:45997)
0808 07:10:04.378119 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.378121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.378391 (+ 270us) server_negotiation.cc:407] Connection header received
0808 07:10:04.379019 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.379021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.379034 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.379066 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.380014 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.380754 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.382119 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.382398 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.382485 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.384821 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.384823 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.384823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.384832 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.386388 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.386776 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.386777 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.386777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.386837 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.387064 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.387084 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.387084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.387200 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.387255 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.387559 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.387642 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:10:04.387874 31152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.378051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.126:45997 (local address 127.0.0.1:47134)
0808 07:10:04.378252 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.378299 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:04.378896 (+ 597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:04.379261 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:04.379265 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:04.379627 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:04.379917 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.379925 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.380818 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.380819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.382029 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.382032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.382504 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.382505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.382614 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.383097 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:04.383106 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:04.384744 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:04.386480 (+ 1736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.386487 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.386489 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.386709 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.386890 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.386891 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.386891 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.387007 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.387255 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:04.387262 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:04.387401 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 07:10:04.387491 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 07:10:04.387654 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":31,"thread_start_us":95,"threads_started":1}
I20260808 07:10:04.388398 31160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.379412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42876 (local address 127.29.82.124:35653)
0808 07:10:04.379739 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.379744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.379769 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:10:04.379791 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.379793 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.379813 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.379926 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.380676 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.382095 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.382922 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.383245 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.383303 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.385828 (+ 2525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.385837 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.385837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.385844 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.387288 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.387597 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.387600 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.387601 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.387659 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.387837 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.387839 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.387839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.388022 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.388161 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.388229 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.388307 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":292,"thread_start_us":81,"threads_started":1}
I20260808 07:10:04.388634 31150 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:10:04.389899 30937 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } attempt: 2
Aug 08 07:10:04 dist-test-slave-rmhg krb5kdc[30813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173004, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.124@KRBTEST.COM for kudu/127.29.82.125@KRBTEST.COM
Aug 08 07:10:04 dist-test-slave-rmhg krb5kdc[30813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.126@KRBTEST.COM
Aug 08 07:10:04 dist-test-slave-rmhg krb5kdc[30813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173003, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.126@KRBTEST.COM for kudu/127.29.82.124@KRBTEST.COM
I20260808 07:10:04.395947 31152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.388877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.125:45353 (local address 127.0.0.1:48908)
0808 07:10:04.388913 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.388924 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:04.388966 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:04.389212 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:04.389213 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:04.389359 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:04.389421 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.389424 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.390114 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.390115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.391020 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.391022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.391513 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.391513 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.391582 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.391964 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:04.391969 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:04.393253 (+ 1284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:04.394773 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.394774 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.394774 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.395182 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.395381 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.395381 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.395382 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.395435 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.395677 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:04.395678 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:04.395720 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 07:10:04.395765 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:10:04.395854 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260808 07:10:04.396117 31050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.389002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48908 (local address 127.29.82.125:45353)
0808 07:10:04.389046 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.389048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.389056 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:10:04.389081 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.389082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.389093 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.389145 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.389522 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.390023 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.391126 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.391437 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.391516 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.393333 (+ 1817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.393334 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.393334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.393342 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.394679 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.395255 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.395256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.395256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.395314 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.395500 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.395501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.395502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.395621 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.395902 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.395942 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.396032 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:10:04.396659 31150 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:10:04.396837 30940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.389110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47148 (local address 127.29.82.126:45997)
0808 07:10:04.389146 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.389174 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.389181 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:10:04.389260 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.389261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.389268 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.389305 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.389797 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.390361 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.391263 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.391468 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.391521 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.394141 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.394143 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.394143 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.394175 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.395613 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.395973 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.395974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.395974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.396029 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.396219 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.396221 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.396221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.396346 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.396511 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.396685 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.396752 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:10:04.397806 30941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.390125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:35653 (local address 127.0.0.1:42892)
0808 07:10:04.390161 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.390170 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:04.390203 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:04.390320 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:04.390321 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:04.390468 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:04.390500 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.390501 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.391070 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.391071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.391746 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.391749 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.393054 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.393056 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.393129 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.393605 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:04.393610 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:04.394862 (+ 1252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:04.396511 (+ 1649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.396513 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.396513 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.396716 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.397222 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.397223 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.397223 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.397290 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.397528 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:04.397528 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:04.397571 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 07:10:04.397632 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:10:04.397716 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260808 07:10:04.398149 31160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.390164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42892 (local address 127.29.82.124:35653)
0808 07:10:04.390202 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.390204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.390211 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:10:04.390246 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.390247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.390255 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.390301 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.390568 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.391006 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.391811 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.392946 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.393042 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.394940 (+ 1898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.394941 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.394941 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.394946 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.396432 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.396789 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.396789 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.396790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.396952 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.397345 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.397345 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.397346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.397477 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.397535 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.397981 (+ 446us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.398058 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":20}
I20260808 07:10:04.399586 30937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691: Bootstrap starting.
I20260808 07:10:04.400369 30937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691: Neither blocks nor log segments found. Creating new log.
I20260808 07:10:04.400710 30937 log.cc:824] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:04.401680 30937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691: No bootstrap required, opened a new log
Aug 08 07:10:04 dist-test-slave-rmhg krb5kdc[30813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173004, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.124@KRBTEST.COM for kudu/127.29.82.124@KRBTEST.COM
Aug 08 07:10:04 dist-test-slave-rmhg krb5kdc[30813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.82.125@KRBTEST.COM
I20260808 07:10:04.403738 30937 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } }
I20260808 07:10:04.403901 30937 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b290f7d42ac4f858ec2f5901a1b8691, State: Initialized, Role: FOLLOWER
I20260808 07:10:04.404008 30937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } }
I20260808 07:10:04.404321 31164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } } }
I20260808 07:10:04.404392 30937 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:10:04.404521 31164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:10:04.405509 31152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.396939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:35653 (local address 127.0.0.1:42894)
0808 07:10:04.397005 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.397013 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:04.397044 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:04.397560 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:04.397561 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:04.397692 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:04.397724 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.397726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.398917 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.398918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.399683 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.399685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.400211 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.400212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.400256 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.400611 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:04.400616 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:04.402597 (+ 1981us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:04.404439 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.404440 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.404440 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.404631 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.404809 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.404809 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.404809 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.404855 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.405135 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:04.405136 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:04.405206 (+ 70us) client_negotiation.cc:769] Sending connection context
0808 07:10:04.405277 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 07:10:04.405383 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 07:10:04.405622 31161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.397050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42894 (local address 127.29.82.124:35653)
0808 07:10:04.397227 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.397229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.397238 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:10:04.397259 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.397259 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.397270 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.397341 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.397792 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.398833 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.399766 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.400109 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.400168 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.402686 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.402688 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.402688 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.402694 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.404340 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.404701 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.404702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.404703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.404756 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.404903 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.404904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.404904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.405071 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.405141 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.405306 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.405444 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":155,"thread_start_us":90,"threads_started":1}
I20260808 07:10:04.405777 31050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.397751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48914 (local address 127.29.82.125:45353)
0808 07:10:04.397783 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.397784 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.397791 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:10:04.397829 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.397829 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.397837 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.397881 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.398440 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.398874 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.399782 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.399995 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.400049 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.402731 (+ 2682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.402732 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.402733 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.402740 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.404250 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.404652 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.404653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.404654 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.404712 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.404892 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.404892 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.404893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.405006 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.405201 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.405623 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.405696 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:10:04.407202 31150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27: Bootstrap starting.
I20260808 07:10:04.407812 31150 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27: Neither blocks nor log segments found. Creating new log.
I20260808 07:10:04.408068 31150 log.cc:824] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:04.408885 31150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27: No bootstrap required, opened a new log
W20260808 07:10:04.409058 31183 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:10:04.409113 31183 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:10:04.407498 30832 master_runner.cc:186] Error getting master registration for 127.29.82.125:45353: OK, instance_id { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" instance_seqno: 1786173004217881 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:10:04.409435 30832 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:10:04.409612 30025 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:10:04.410544 30891 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "8b290f7d42ac4f858ec2f5901a1b8691"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47148
I20260808 07:10:04.410566 31150 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } }
I20260808 07:10:04.410668 30891 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 07:10:04.410696 31150 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62889624bd384e9890b9270e85b67c27, State: Initialized, Role: FOLLOWER
I20260808 07:10:04.410724 30891 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:10:04.410780 31150 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } }
I20260808 07:10:04.411024 31187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } } }
I20260808 07:10:04.411087 31150 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:10:04.411127 31187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:10:04.411643 30891 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } }
I20260808 07:10:04.411880 30891 leader_election.cc:288] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [CANDIDATE]: Term 1 election: Requested vote from peers 0803e608c43446e3bf7c7f4220b837c2 (127.29.82.125:45353), 62889624bd384e9890b9270e85b67c27 (127.29.82.124:35653)
W20260808 07:10:04.413015 31203 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:10:04.413075 31203 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:10:04.412253 31113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "62889624bd384e9890b9270e85b67c27"
I20260808 07:10:04.413817 31113 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:10:04.415026 31113 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b290f7d42ac4f858ec2f5901a1b8691 in term 1.
I20260808 07:10:04.415211 30854 leader_election.cc:302] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62889624bd384e9890b9270e85b67c27, 8b290f7d42ac4f858ec2f5901a1b8691; no voters:
I20260808 07:10:04.415354 31164 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:10:04.415534 31164 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [term 1 LEADER]: Becoming Leader. State: Replica: 8b290f7d42ac4f858ec2f5901a1b8691, State: Running, Role: LEADER
I20260808 07:10:04.415632 31164 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } }
I20260808 07:10:04.416074 31164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b290f7d42ac4f858ec2f5901a1b8691. Latest consensus state: current_term: 1 leader_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } } }
I20260808 07:10:04.416159 31164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [sys.catalog]: This master's current role is: LEADER
I20260808 07:10:04.416505 31054 master_runner.cc:186] Error getting master registration for 127.29.82.125:45353: OK, instance_id { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" instance_seqno: 1786173004217881 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:10:04.418838 31054 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:10:04.421343 31221 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:10:04.421944 31221 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:10:04.424278 30940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.413337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47158 (local address 127.29.82.126:45997)
0808 07:10:04.413375 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.413377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.414284 (+ 907us) server_negotiation.cc:407] Connection header received
0808 07:10:04.414380 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.414381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.414392 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.414420 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.415924 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.416681 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.417728 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.418018 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.418083 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.420480 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.420483 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.420483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.420501 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.422504 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.423132 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.423133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.423134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.423200 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.423524 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.423526 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.423526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.423662 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.423737 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.424091 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.424181 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:10:04.429289 31113 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27 [term 1 FOLLOWER]: Refusing update from remote peer 8b290f7d42ac4f858ec2f5901a1b8691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:10:04.429673 31218 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:10:04.431689 31187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b290f7d42ac4f858ec2f5901a1b8691. Latest consensus state: current_term: 1 leader_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } } }
I20260808 07:10:04.431792 31187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:10:04.433902 31161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.414027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42900 (local address 127.29.82.124:35653)
0808 07:10:04.414061 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.414063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.417824 (+ 3761us) server_negotiation.cc:407] Connection header received
0808 07:10:04.417907 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.417908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.417920 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.417944 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.418658 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.419327 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.420336 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.420661 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.420702 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.429535 (+ 8833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.429537 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.429538 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.429546 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.432485 (+ 2939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.432918 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.432919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.432920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.432985 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.433254 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.433255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.433255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.433403 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.433504 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.433716 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.433805 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:10:04.435141 31218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } } }
I20260808 07:10:04.435249 31218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [sys.catalog]: This master's current role is: LEADER
I20260808 07:10:04.435601 31187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } } }
I20260808 07:10:04.435680 31187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:10:04.435626 31222 mvcc.cc:205] Tried to move back new op lower bound from 7316164626138640384 to 7316164626087190528. Current Snapshot: MvccSnapshot[applied={T|T < 7316164626138640384}]
I20260808 07:10:04.436278 31223 mvcc.cc:205] Tried to move back new op lower bound from 7316164626138640384 to 7316164626087190528. Current Snapshot: MvccSnapshot[applied={T|T < 7316164626138640384}]
I20260808 07:10:04.436920 31221 catalog_manager.cc:1347] Generated new cluster ID: 53997ad15cab4d13819ccba0df0d4ee1
I20260808 07:10:04.436966 31221 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:10:04.442598 31050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.413734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48920 (local address 127.29.82.125:45353)
0808 07:10:04.413774 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.413776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.416011 (+ 2235us) server_negotiation.cc:407] Connection header received
0808 07:10:04.416105 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.416106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.416118 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.416147 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.416839 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.417574 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.428062 (+ 10488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.428995 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.429047 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.432696 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.432698 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.432698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.432707 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.434533 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.436616 (+ 2083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.436618 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.436618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.436700 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.441730 (+ 5030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.441732 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.441732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.441908 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.441987 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.442369 (+ 382us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.442483 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:10:04.447829 31221 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:10:04.448665 31221 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:10:04.452917 31043 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } attempt: 3
Aug 08 07:10:04 dist-test-slave-rmhg krb5kdc[30813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786173004, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.82.125@KRBTEST.COM for kudu/127.29.82.124@KRBTEST.COM
I20260808 07:10:04.461758 31221 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691: Generated new TSK 0
I20260808 07:10:04.462306 31221 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:10:04.462393 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.453227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.82.124:35653 (local address 127.0.0.1:42912)
0808 07:10:04.453330 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 07:10:04.453342 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:10:04.453386 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:10:04.453583 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:10:04.453585 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:10:04.453777 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:10:04.453826 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.453828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.454758 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.454759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.455586 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:10:04.455589 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.456071 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.456072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:10:04.456130 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.456639 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:10:04.456645 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:10:04.458762 (+ 2117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:10:04.460823 (+ 2061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.460824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.460825 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.461060 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.461411 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:10:04.461412 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:10:04.461412 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:10:04.461495 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:10:04.462077 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:10:04.462078 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:10:04.462125 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 07:10:04.462183 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:10:04.462287 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 07:10:04.462769 31161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:04.453285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42912 (local address 127.29.82.124:35653)
0808 07:10:04.453343 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.453345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.453438 (+ 93us) server_negotiation.cc:407] Connection header received
0808 07:10:04.453472 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.453473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.453483 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.453525 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.453903 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.454677 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.455671 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:04.455998 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:04.456076 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:04.458841 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:10:04.458842 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:10:04.458843 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:10:04.458851 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:10:04.460744 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.461130 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.461131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.461132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.461224 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:10:04.461836 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:10:04.461837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:10:04.461838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:10:04.461987 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:10:04.462049 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:04.462593 (+ 544us) server_negotiation.cc:299] Negotiation successful
0808 07:10:04.462678 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:10:04.464262 31043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2: Bootstrap starting.
I20260808 07:10:04.465063 31043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2: Neither blocks nor log segments found. Creating new log.
I20260808 07:10:04.465405 31043 log.cc:824] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:10:04.467756 31043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2: No bootstrap required, opened a new log
I20260808 07:10:04.469772 31043 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } }
I20260808 07:10:04.469914 31043 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0803e608c43446e3bf7c7f4220b837c2, State: Initialized, Role: FOLLOWER
I20260808 07:10:04.469995 31043 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } }
I20260808 07:10:04.470316 31043 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:10:04.470973 31003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0803e608c43446e3bf7c7f4220b837c2"
I20260808 07:10:04.471089 31003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:10:04.471957 31003 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b290f7d42ac4f858ec2f5901a1b8691 in term 1.
I20260808 07:10:04.472434 31002 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2 [term 1 FOLLOWER]: Refusing update from remote peer 8b290f7d42ac4f858ec2f5901a1b8691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:10:04.473086 31218 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 07:10:04.476505 31250 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:10:04.476614 31250 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:10:04.476771 31231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } } }
I20260808 07:10:04.476890 31231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:10:04.476980 31231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b290f7d42ac4f858ec2f5901a1b8691. Latest consensus state: current_term: 1 leader_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } } }
I20260808 07:10:04.477095 31231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:10:04.477193 31231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } } }
I20260808 07:10:04.477286 31231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:10:04.478720 31252 mvcc.cc:205] Tried to move back new op lower bound from 7316164626268643328 to 7316164626087190528. Current Snapshot: MvccSnapshot[applied={T|T < 7316164626138640384}]
W20260808 07:10:04.492964 30940 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:04.491228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47160 (local address 127.29.82.126:45997)
0808 07:10:04.491277 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.491279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.492226 (+ 947us) server_negotiation.cc:407] Connection header received
0808 07:10:04.492328 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.492330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.492343 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.492374 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.492884 (+ 510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47160: BlockingRecv error: recv got EOF from 127.0.0.1:47160 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 07:10:04.493923 31050 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:04.491648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48924 (local address 127.29.82.125:45353)
0808 07:10:04.491690 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.491692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.493257 (+ 1565us) server_negotiation.cc:407] Connection header received
0808 07:10:04.493352 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.493354 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.493365 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.493392 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.493844 (+ 452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48924: BlockingRecv error: recv got EOF from 127.0.0.1:48924 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 07:10:04.494719 31161 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:04.491959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42924 (local address 127.29.82.124:35653)
0808 07:10:04.492001 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.492003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.494174 (+ 2171us) server_negotiation.cc:407] Connection header received
0808 07:10:04.494285 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.494286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.494297 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.494325 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.494658 (+ 333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42924: BlockingRecv error: recv got EOF from 127.0.0.1:42924 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 07:10:04.497238 31050 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:04.496394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48930 (local address 127.29.82.125:45353)
0808 07:10:04.496433 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.496448 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.496666 (+ 218us) server_negotiation.cc:407] Connection header received
0808 07:10:04.496769 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.496771 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.496791 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.496818 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.497147 (+ 329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48930: BlockingRecv error: recv got EOF from 127.0.0.1:48930 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 07:10:04.500504 31050 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:04.499666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48934 (local address 127.29.82.125:45353)
0808 07:10:04.499714 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.499716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.499955 (+ 239us) server_negotiation.cc:407] Connection header received
0808 07:10:04.500057 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.500058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.500071 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.500100 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.500455 (+ 355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48934: BlockingRecv error: recv got EOF from 127.0.0.1:48934 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 07:10:04.504686 31050 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:04.503732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48942 (local address 127.29.82.125:45353)
0808 07:10:04.503770 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.503772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.504086 (+ 314us) server_negotiation.cc:407] Connection header received
0808 07:10:04.504196 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.504197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.504209 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.504237 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.504631 (+ 394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48942: BlockingRecv error: recv got EOF from 127.0.0.1:48942 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 07:10:04.510872 31050 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:04.510005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48950 (local address 127.29.82.125:45353)
0808 07:10:04.510045 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.510047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.510284 (+ 237us) server_negotiation.cc:407] Connection header received
0808 07:10:04.510387 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.510388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.510399 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.510428 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.510816 (+ 388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48950: BlockingRecv error: recv got EOF from 127.0.0.1:48950 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 07:10:04.521436 31050 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:04.520418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48960 (local address 127.29.82.125:45353)
0808 07:10:04.520465 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.520467 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.520777 (+ 310us) server_negotiation.cc:407] Connection header received
0808 07:10:04.520889 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.520891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.520905 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.520935 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.521373 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48960: BlockingRecv error: recv got EOF from 127.0.0.1:48960 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 07:10:04.540004 31050 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:04.539030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48964 (local address 127.29.82.125:45353)
0808 07:10:04.539076 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.539078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.539366 (+ 288us) server_negotiation.cc:407] Connection header received
0808 07:10:04.539474 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.539476 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.539490 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.539521 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.539928 (+ 407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48964: BlockingRecv error: recv got EOF from 127.0.0.1:48964 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 07:10:04.574156 31050 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:04.573398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48968 (local address 127.29.82.125:45353)
0808 07:10:04.573447 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.573449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.573635 (+ 186us) server_negotiation.cc:407] Connection header received
0808 07:10:04.573673 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.573674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.573686 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.573733 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.574092 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48968: BlockingRecv error: recv got EOF from 127.0.0.1:48968 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 07:10:04.640089 31050 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:04.639378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48984 (local address 127.29.82.125:45353)
0808 07:10:04.639452 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.639454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.639543 (+ 89us) server_negotiation.cc:407] Connection header received
0808 07:10:04.639606 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.639608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.639620 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.639669 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.640015 (+ 346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48984: BlockingRecv error: recv got EOF from 127.0.0.1:48984 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 07:10:04.770088 31050 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:04.769399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49000 (local address 127.29.82.125:45353)
0808 07:10:04.769460 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:04.769491 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:04.769564 (+ 73us) server_negotiation.cc:407] Connection header received
0808 07:10:04.769618 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:04.769619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:04.769630 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:04.769692 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:04.770026 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49000: BlockingRecv error: recv got EOF from 127.0.0.1:49000 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:10:04.851509 31218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b290f7d42ac4f858ec2f5901a1b8691" member_type: VOTER last_known_addr { host: "127.29.82.126" port: 45997 } } peers { permanent_uuid: "0803e608c43446e3bf7c7f4220b837c2" member_type: VOTER last_known_addr { host: "127.29.82.125" port: 45353 } } peers { permanent_uuid: "62889624bd384e9890b9270e85b67c27" member_type: VOTER last_known_addr { host: "127.29.82.124" port: 35653 } } }
I20260808 07:10:04.851671 31218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b290f7d42ac4f858ec2f5901a1b8691 [sys.catalog]: This master's current role is: LEADER
W20260808 07:10:05.028047 31050 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:10:05.027407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49012 (local address 127.29.82.125:45353)
0808 07:10:05.027480 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:05.027482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:05.027491 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:10:05.027535 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:05.027536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:05.027548 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:05.027598 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:10:05.027989 (+ 391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49012: BlockingRecv error: recv got EOF from 127.0.0.1:49012 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 07:10:05.413558 31203 catalog_manager.cc:1259] Loaded cluster ID: 53997ad15cab4d13819ccba0df0d4ee1
I20260808 07:10:05.413651 31203 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27: loading cluster ID for follower catalog manager: success
I20260808 07:10:05.414511 31203 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27: acquiring CA information for follower catalog manager: success
I20260808 07:10:05.414815 31203 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 62889624bd384e9890b9270e85b67c27: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:10:05.477126 31250 catalog_manager.cc:1259] Loaded cluster ID: 53997ad15cab4d13819ccba0df0d4ee1
I20260808 07:10:05.477234 31250 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2: loading cluster ID for follower catalog manager: success
I20260808 07:10:05.478021 31250 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2: acquiring CA information for follower catalog manager: success
I20260808 07:10:05.478292 31250 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0803e608c43446e3bf7c7f4220b837c2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:10:05.543877 31358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:05.541320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49026 (local address 127.29.82.125:45353)
0808 07:10:05.541443 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:05.541445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:05.541457 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:10:05.541527 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:05.541528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:05.541580 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:05.541678 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:10:05.541817 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:05.542316 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:05.543147 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:05.543357 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:05.543414 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:05.543529 (+ 115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:10:05.543659 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:10:05.543718 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:05.543764 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 07:10:05.543786 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":53,"threads_started":1}
I20260808 07:10:05.548012 31365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:05.545694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42928 (local address 127.29.82.124:35653)
0808 07:10:05.545813 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:05.545815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:05.545823 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:10:05.545866 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:05.545867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:05.545909 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:05.545979 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:10:05.546086 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:05.546569 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:05.547291 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:05.547495 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:05.547547 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:05.547694 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:10:05.547805 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:10:05.547871 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:05.547896 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 07:10:05.547919 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":47,"threads_started":1}
I20260808 07:10:05.552744 31365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:05.550147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42942 (local address 127.29.82.124:35653)
0808 07:10:05.550189 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:05.550191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:05.550267 (+ 76us) server_negotiation.cc:407] Connection header received
0808 07:10:05.550324 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:05.550325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:05.550335 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:05.550383 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:10:05.550513 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:05.551167 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:05.551966 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:05.552310 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:05.552363 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:05.552482 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:10:05.552512 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:10:05.552542 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:05.552643 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 07:10:05.552670 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:10:05.552744 31358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:05.549853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49034 (local address 127.29.82.125:45353)
0808 07:10:05.549931 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:05.549933 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:05.549940 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:10:05.550019 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:05.550020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:05.550031 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:05.550071 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:10:05.550236 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:05.550967 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:05.551912 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:05.552187 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:05.552250 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:05.552378 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:10:05.552415 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:10:05.552467 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:05.552640 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 07:10:05.552670 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 07:10:05.552772 31373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:10:05.549702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47174 (local address 127.29.82.126:45997)
0808 07:10:05.549830 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 07:10:05.549832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:10:05.549841 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:10:05.549886 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:10:05.549887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:10:05.549944 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:10:05.550068 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:10:05.550164 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:05.550773 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:05.551775 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:10:05.552062 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:10:05.552127 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:10:05.552440 (+ 313us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:10:05.552557 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:10:05.552617 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:10:05.552675 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 07:10:05.552699 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":57,"threads_started":1}
I20260808 07:10:05.554462 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 30832
I20260808 07:10:05.567629 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 30945
I20260808 07:10:05.583874 30025 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZ8Eis0/build/release/bin/kudu with pid 31054
2026-08-08T07:10:05Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2946 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5858 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (303846 ms total)
[ PASSED ] 54 tests.
[ FAILED ] 2 tests, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
2 FAILED TESTS